-- Logs begin at Thu 2022-05-26 19:13:00 UTC, end at Thu 2022-05-26 20:45:45 UTC. -- May 26 20:14:08.788164 dv-cinder-842131-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 20:14:08.796841 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 20:14:08 2022] *** May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: nodename: dv-cinder-842131-1-iscsi May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: machine: x86_64 May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: clock source: unix May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: pcre jit disabled May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: detected number of CPU cores: 4 May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: current working directory: / May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: detected binary path: /usr/bin/uwsgi-core May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: your processes number limit is 47680 May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: your memory page size is 4096 bytes May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: detected max file descriptor number: 2048 May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: lock engine: pthread robust mutexes May 26 20:14:08.799031 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: thunder lock: enabled May 26 20:14:08.800027 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 20:14:08.800027 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 20:14:08.844152 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: Python main interpreter initialized at 0x55fae0b709c0 May 26 20:14:08.844152 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: python threads support enabled May 26 20:14:08.844152 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: your server socket listen backlog is limited to 100 connections May 26 20:14:08.844152 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: your mercy for graceful operations on workers is 90 seconds May 26 20:14:08.844505 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: mapped 403077 bytes (393 KB) for 2 cores May 26 20:14:08.844584 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: *** Operational MODE: preforking *** May 26 20:14:08.844816 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: *** uWSGI is running in multiple interpreter mode *** May 26 20:14:08.844816 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: spawned uWSGI master process (pid: 103818) May 26 20:14:08.845017 dv-cinder-842131-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 20:14:08.845669 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: spawned uWSGI worker 1 (pid: 103819, cores: 1) May 26 20:14:08.847325 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: spawned uWSGI worker 2 (pid: 103820, cores: 1) May 26 20:14:08.847325 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 20:14:10.028513 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 20:14:10.030206 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 20:14:10.755115 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 20:14:10.755115 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: from cryptography.utils import int_from_bytes May 26 20:14:10.755445 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 20:14:10.755445 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: from cryptography.utils import int_from_bytes May 26 20:14:10.756099 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 20:14:10.756099 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: from cryptography.utils import int_from_bytes May 26 20:14:10.756436 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 20:14:10.756436 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: from cryptography.utils import int_from_bytes May 26 20:14:13.368931 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 20:14:13.369517 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 20:14:13.369696 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 20:14:13.370052 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 20:14:13.370261 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 20:14:13.370640 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 20:14:13.370736 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 20:14:13.370818 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.371023 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.371122 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 20:14:13.371343 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.371434 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 20:14:13.371648 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 20:14:13.371745 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.371970 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.372072 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.372277 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.372374 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.372594 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.372682 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.372909 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.373008 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.373231 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.373318 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.373488 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.373584 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.374355 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.374525 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.374679 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842131-1-iscsi {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.374798 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.374998 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.375125 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.375302 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.375426 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.375609 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.375725 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.375924 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.376060 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842131-1-iscsi {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.376232 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.376347 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.376538 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.376652 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.376841 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.376963 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.377161 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.377338 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.377487 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.377775 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.377909 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.378080 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.378192 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.378415 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.378607 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.378742 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.379060 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.379194 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.379344 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.379428 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.379554 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.379644 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.379843 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.379939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.380156 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.380254 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.380465 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.380565 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.380784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.380926 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842131-1-iscsi {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.381120 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.381270 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.381414 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.381509 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.381724 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.381864 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.382119 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842131-1-iscsi {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.382208 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.382457 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.382547 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.382768 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.382879 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.383080 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.383169 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.383395 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.383494 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.383699 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.383786 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.384018 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.384123 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.384332 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.384432 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.384643 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.384741 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.384953 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.385041 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.385248 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.385337 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.385554 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.385648 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.385857 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.385945 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.386172 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.386282 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.386497 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.386598 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.386796 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.386885 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.387040 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.387130 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.387343 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.387446 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.387657 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.387756 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.387973 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.388067 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.388255 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.388347 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.388524 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.388620 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.388770 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.388859 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.389082 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.389177 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.389449 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.390132 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.390351 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.390600 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.390757 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.390897 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.391001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.391085 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.391181 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.391377 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.391478 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.391683 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.391780 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.391988 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.392084 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.392293 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.392380 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.392599 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.392698 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.392913 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.393000 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.393218 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.393305 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.393530 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.393627 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.393833 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.393925 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.394144 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.394236 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.394492 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.394583 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.394803 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.394891 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.395108 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.395279 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.395442 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.395529 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.395743 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.395829 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.396048 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.396143 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.396361 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.396450 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.396678 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.396766 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.396987 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.397081 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.397287 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.397380 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.397591 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.397679 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.397904 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.398001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.398208 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.398349 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.398537 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.398625 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.398784 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.398873 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.399080 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.399166 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.399381 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.399469 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.399690 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.399863 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.400042 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.400190 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.400329 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.400469 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.400615 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.400764 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.400898 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.401033 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.401188 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.401333 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.401580 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.401718 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.401852 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.401987 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.402120 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.402274 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.402419 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.402556 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.402707 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.402848 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.402990 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.403135 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.403271 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.403406 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.403548 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.403682 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.403839 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.403986 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.404152 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.404295 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.404452 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.404607 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.404746 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.404891 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.405078 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.405212 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.405408 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.405570 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.405809 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.405953 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.406121 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.406469 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.406660 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.406794 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.407048 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.407196 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.407374 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.407561 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.407701 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.407992 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.408128 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.408300 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.408501 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.408632 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.408829 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.408995 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.409131 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.409283 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.409447 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.409580 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.409800 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.410004 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.410149 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.410395 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.410529 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.410715 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.410806 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.411048 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.411192 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.411333 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.411433 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.411640 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.411739 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.411944 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.412046 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.412248 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.412550 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.412644 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.412853 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.413087 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.413184 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.413462 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.413638 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.413783 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.413975 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.414092 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.414318 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.414412 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.414632 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.414722 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.414958 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.415061 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.415286 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.415375 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.415601 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.415690 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.415913 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.416011 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.416223 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.416310 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.416541 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:14:13.416636 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.416887 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.417040 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.417217 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.417305 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.417530 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.417625 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.417848 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.417944 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.418175 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.418284 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.418514 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.418601 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.418829 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.418918 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.419138 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.419224 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.419453 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.419541 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.419773 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.419866 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.420083 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.420174 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.420394 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.420481 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.420735 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.420830 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.421059 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.421371 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.421564 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.421674 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.421925 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.422097 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.422451 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.422541 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.422767 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.422971 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.423144 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.423304 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.423495 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.423635 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.423810 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.423966 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.424135 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.424456 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.424555 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.424770 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.424881 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.425083 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.425210 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.425396 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.425518 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.425719 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.425952 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.426048 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.426325 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.426417 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.426696 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.426839 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.427012 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.427328 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.427416 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.427640 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.427956 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.428042 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.428271 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.428371 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.428606 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.428696 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.428920 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.429087 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.429236 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.429327 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.429552 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.429639 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.429869 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.429957 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.430185 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.430337 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.430524 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.430612 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.430839 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.430928 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.431146 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.431236 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.431451 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.431538 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.431758 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.431844 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.432071 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.432170 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.432374 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.432462 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.432690 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.432786 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.433007 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.433096 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.433314 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.433400 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.433625 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.433719 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.433939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.434029 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.434262 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.434365 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.434581 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.434731 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.434885 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.434985 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.435188 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.435284 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.435496 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.435600 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.435798 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.435893 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.436102 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.436200 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.436937 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.437081 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.437244 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.437354 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.437549 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.437645 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.437874 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.437995 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.438178 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.438312 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.438509 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.438604 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.438817 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.438911 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.439120 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.439215 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.439430 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.439525 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.439740 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.439836 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.440043 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.440144 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.440362 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.440461 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.440668 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.440761 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.440973 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.441061 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.441298 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.441405 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.441602 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.441690 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.441905 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.441998 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.442217 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.442337 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.442552 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.442645 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.442865 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.442958 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.443170 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.443267 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.443476 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.443562 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.443781 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.443865 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.444084 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.444171 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.444386 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.444472 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.444697 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.444793 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.444999 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.445088 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.445302 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.445388 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.445605 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.445696 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.445907 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.446003 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.446209 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.446325 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.446551 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.446635 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.446858 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.446945 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.447159 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.447251 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.447459 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.447626 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.447757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.447848 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.448063 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.448146 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.448364 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.448458 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.448666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.448751 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.448966 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.449060 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.449265 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.449359 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.449564 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.449651 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.449880 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.449973 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.450186 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.450308 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.450514 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.450607 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.450816 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.450903 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.451119 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.451213 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.451458 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.451556 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.451756 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.451841 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.452744 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.452842 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.453081 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.453253 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.453403 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.453576 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.453726 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.453907 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.454039 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.454226 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.454379 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.454573 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.454711 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.454882 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.455065 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.455202 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.455545 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.455637 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.455878 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.456201 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.456285 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.456526 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.456784 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.456878 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.457149 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.457369 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.457728 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.458047 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.458401 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.458724 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.458874 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.459074 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.459252 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.459402 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.459550 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.459709 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.459866 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.460007 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.460154 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.460311 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.460463 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.460646 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.460779 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.461111 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.461499 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.461707 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.462002 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.462090 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.462389 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.462612 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.462740 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.463032 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.463195 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.463356 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.463693 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.463787 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.464035 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.464350 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.464444 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.465115 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.465199 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.465443 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.465577 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.465773 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.465933 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.466093 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.466299 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.466454 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.466649 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.466771 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.467098 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.467323 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.467415 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.467726 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.467913 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.468076 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.468262 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.468414 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.468598 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.468760 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.468936 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.469097 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.469256 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.469401 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.469552 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.469806 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.469959 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.470124 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.470311 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.470454 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.470594 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.470737 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.470878 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.471033 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.471173 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.471287 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.471557 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.471706 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.471861 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.471948 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.472176 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.472261 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.472485 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.472578 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.472797 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.472884 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.473109 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.473261 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.473421 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.473551 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.473718 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.473925 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.474068 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.474231 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.474394 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.474554 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.474707 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.474869 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.475010 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.475191 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.475326 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.475501 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.475631 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.475822 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.475963 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.476142 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.476267 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.476445 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.476579 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.476745 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.476871 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.477067 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.477200 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.477375 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.477503 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.477684 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.477820 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.477988 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.478113 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.478313 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.478445 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.478655 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.478799 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.478962 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.479098 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.479265 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.479392 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.479581 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.479705 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.479899 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.480040 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.480209 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.480335 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.480520 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.480654 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.480828 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.481063 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.481195 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.481316 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.481694 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.481982 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.482113 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.482337 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.482462 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.482611 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.482738 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.482924 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.483076 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.483294 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.483420 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.483609 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.483745 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.483932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.484076 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.484239 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.484409 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.484535 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.484768 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.484908 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.485087 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.485229 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.485405 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.485532 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.485720 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.485848 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.486035 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.486307 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.486438 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.486642 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.486768 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.486958 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.487099 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.487275 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.487402 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.487594 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.487717 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.487906 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.488052 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.488226 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.488353 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.488554 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.488738 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.488862 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.488993 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.489185 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.489325 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.489491 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.489616 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.489795 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.489922 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.490099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.490225 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.490436 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.490562 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.490741 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.490877 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.491043 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.491170 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.491344 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.491470 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.491652 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.491774 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.491971 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.492103 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.492225 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.492345 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.492531 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.492657 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.492836 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.492963 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.493138 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.493270 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.493439 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.493576 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.493752 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.493879 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.494052 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.494179 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.494396 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.494540 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.494705 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.494839 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.495008 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.495137 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.495314 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.495446 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.495600 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.495722 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.495941 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.496068 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.496243 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.496386 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.496576 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.496706 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.496903 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.497030 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.497218 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.497354 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.497530 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.497654 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.497831 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.497952 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.498143 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.498351 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.498480 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.498599 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.499283 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.499493 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.499678 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.499870 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.499969 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.500187 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.500285 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.500497 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.500597 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.500800 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.500889 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.501111 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.501200 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.501423 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.501512 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.501733 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.501828 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.502045 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.502143 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.502373 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.502465 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.502683 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.502769 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.502985 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.503104 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.503299 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.503404 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.503602 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.503690 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.503903 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.503990 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.504204 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.504327 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.504510 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.504775 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.504862 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.505101 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.505202 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.505409 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.505627 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.505715 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.506011 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.506177 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.506337 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.506577 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.506673 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.506933 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.507027 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.507242 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.507510 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.507606 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.507836 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.507961 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.508157 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.508390 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.508478 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.508774 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.508857 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.509058 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.509290 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.509388 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.509650 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.509758 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.509951 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.510268 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.510395 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.510595 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.510690 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.510908 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.510997 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.511212 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.511307 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.511518 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.511614 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.511819 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.511905 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.512124 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.512305 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.512434 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.512554 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.512717 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.512818 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.513016 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.513112 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.513387 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.513486 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.513613 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.513703 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.513912 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.514014 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.514210 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.514319 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.515254 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.515420 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.515584 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.515756 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.515901 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.515989 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.516195 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.516296 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.516556 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.516644 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.516900 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.517074 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.517217 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.517519 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.517609 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.517867 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.517990 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.518181 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.518516 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.518631 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.518825 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.519010 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.519137 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.519449 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.519534 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.519750 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.519878 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.520061 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.520328 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.520415 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.520667 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.520826 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.520968 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.521268 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.521363 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.521586 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.521757 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.521897 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.522091 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.522193 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.522449 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.522547 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.522780 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.522869 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.523097 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.523184 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.523434 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.523571 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.523730 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.523817 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.524039 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.524125 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.524346 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.524432 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.524651 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.524740 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.524955 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.525041 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.525263 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.525360 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.525573 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.525663 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.525884 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.525970 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.526234 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.526360 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.526531 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.526618 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.526832 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.526924 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.527144 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.527244 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.527450 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.527655 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.527743 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.528085 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.528181 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.528394 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.528645 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.528744 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.528985 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.529116 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.529287 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.529596 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.529683 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.529896 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.530178 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.530441 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.530535 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.530762 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.530965 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.531070 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.531364 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.531625 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.531724 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.531969 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.532113 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.532288 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.532540 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.532674 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.532858 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.532984 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.533180 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.533304 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.533503 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.533646 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.533831 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.533974 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.534144 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.534293 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.534482 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.534623 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.534781 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.534901 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.535090 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.535222 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.535412 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.535545 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.535714 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.535837 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.536013 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.536136 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.536313 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.536448 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.536631 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.536762 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.536934 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.537055 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.537250 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.537383 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.537627 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.537748 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.537937 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.538073 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.538351 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.538484 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.538612 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.538733 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.538935 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.539090 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.539242 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.539452 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.539585 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.539859 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.539993 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.540177 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.540319 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.540482 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.540793 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.540927 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.541100 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.541388 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.541535 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.541722 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.541877 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.542022 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.542332 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.542482 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.542659 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.542786 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.542942 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.543246 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.543382 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.543555 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.543717 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.543858 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.544188 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.544319 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.544569 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.544700 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.544876 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.545017 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.545195 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.545339 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.545518 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.545652 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.545869 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.546103 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.546377 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.546574 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.546726 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.546858 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.546991 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.547135 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.547279 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.547413 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.547556 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.547700 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.547842 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.547976 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.548118 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.548251 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.548383 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.548552 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.548697 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.548876 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.549002 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.549134 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.549276 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.549432 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.549647 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.549783 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.549924 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.550056 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.550198 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.550353 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.550501 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.550666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.550805 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.550984 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.551115 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.551288 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.551426 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.551608 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.551758 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.551914 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.552058 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.552205 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.552339 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.552505 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.552640 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.552808 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.552899 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.553139 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.553227 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.553436 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.553521 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.553755 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.553887 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.554068 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.554155 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.554417 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.554509 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.554721 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.554824 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.555038 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.555125 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.555360 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.555448 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.555670 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.555765 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.555981 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.556068 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.556287 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.556373 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.556588 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.556687 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.556895 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.556983 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.557200 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.557295 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.557500 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.557596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.557799 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.557886 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.558098 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.558193 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.558429 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.558519 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.558729 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.558861 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.559028 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.559199 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.559315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.559508 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.559628 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.559828 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.559923 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.560158 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.560255 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.560466 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.560553 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.560774 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.560866 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.561087 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.561184 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.561938 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.562105 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.562305 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.562476 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.562676 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.562773 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.563010 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.563100 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.563326 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.563415 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.563643 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.563732 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.563951 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.564038 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.564261 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.564347 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.564574 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.564662 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.564888 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.564975 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.565204 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.565300 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.565515 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.565603 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.565825 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.565913 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.566134 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.566230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.566473 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.566562 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.566790 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.566890 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.567097 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.567198 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.567410 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.567497 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.567722 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.567817 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.568036 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.568132 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.568369 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.568569 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.568696 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.568895 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.569018 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.569207 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.569339 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.569516 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.569660 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.569840 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.569983 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.570133 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.570302 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.570468 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.570627 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.570773 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.570950 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.571079 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.571264 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.571384 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.571584 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.571680 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.571904 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.572000 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.572225 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.572312 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.572613 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.572769 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.572942 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.573105 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.573252 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.573425 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.573562 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.573743 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.573871 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.574061 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.574179 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.574405 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.574553 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.574724 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.574866 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.575040 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.575168 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.575362 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.575479 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.575677 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.575788 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.575990 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.576085 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.576323 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.576419 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.576647 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.576735 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.577036 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.577192 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.577399 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.577549 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.577743 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.577831 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.578063 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.578158 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.578410 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.578502 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.578732 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.578819 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.579068 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.579205 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.579398 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.579488 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.579709 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.579797 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.580018 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.580114 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.580328 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.580417 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.580639 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.580727 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.580955 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.581156 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.581271 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.581469 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.581587 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.581796 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.581890 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.582119 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.582208 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.582472 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.582560 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.582789 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.582888 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.583105 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.583201 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.583428 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.583523 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.583731 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.583828 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.584030 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.584162 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.584338 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.584425 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.584647 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.584753 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.584949 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.585036 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.585267 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.585507 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.585596 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.585827 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.585915 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.586163 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.586269 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.586494 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.586593 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.586843 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.587028 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.587165 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.587375 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.587489 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.587692 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.587820 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.588015 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.588131 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.588336 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.588444 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.588649 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.588759 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.588954 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.589075 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.589275 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.589385 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.589578 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.589713 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.589880 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.590028 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.590192 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.590364 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.590527 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.590693 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.590828 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.591010 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.591129 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.591436 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.591549 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.591741 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.591901 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.592041 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.592224 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.592348 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.593140 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.593378 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.593539 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.593710 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.593834 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.594021 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.594124 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.594372 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.594465 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.594685 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.594787 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.594995 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.595083 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.595315 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.595402 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.595621 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.595722 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.595928 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.596017 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.596233 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.596322 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.596545 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.596647 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.596850 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.596940 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.597156 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.597242 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.597455 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.597543 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.597767 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.597856 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.598069 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.598164 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.598399 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.598500 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.598714 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.598801 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.599025 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.599113 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.599344 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.599433 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.599641 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.599728 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.599949 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.600035 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.600255 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.600349 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.600559 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.600653 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.600871 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.600957 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.601178 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.601267 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.601492 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.601587 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.601800 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.601897 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.602118 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.602363 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.602467 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.602702 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.602790 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.603025 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.603114 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.603358 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.603455 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.603689 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.603776 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.603996 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.604085 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.604301 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.604388 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.604607 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.604694 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.604929 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.605017 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.605240 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.605357 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.605550 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.605658 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.605860 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.605948 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.606167 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.606284 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.606775 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.607020 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.607112 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.607360 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.607449 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.607670 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.607757 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.607978 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.608067 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.608886 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.608983 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.609202 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.609299 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.609580 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.609667 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.609891 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.609992 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.610206 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.610401 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.610569 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.610657 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.610890 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.610977 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.611202 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.611298 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.611516 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.611602 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.611827 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.611912 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.612135 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.612221 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.612443 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.612529 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.612749 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.612835 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.613054 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.613142 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.613367 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.613462 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.613679 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.613774 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.613990 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.614077 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.614316 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.614418 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.614637 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.614739 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.614977 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.615127 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.615303 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.615397 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.615625 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.615727 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.615939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.616025 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.616257 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.616343 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.616567 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.616666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.616875 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.616968 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.617184 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.617271 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.617495 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.617589 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.617816 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.617903 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.618146 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.618231 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.618488 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.618589 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.618800 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.618887 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.619154 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.619253 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.619407 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.619524 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.619708 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.619845 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.620012 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.620174 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.620327 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.620486 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.620634 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.620809 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.620935 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.621133 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.621221 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.621449 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.621535 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.621774 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.621862 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.622088 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.622176 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.622411 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.622499 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.622712 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.622800 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.623018 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.623108 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.623315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.623415 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.623617 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.623725 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.624357 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.624443 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.624522 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.624597 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.624663 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.624743 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.624828 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.624991 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.625110 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.625304 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.625411 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.625611 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.625701 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.625924 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.626012 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.626235 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.626343 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.626565 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.626655 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.626875 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.626974 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.627182 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.627290 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.627488 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.627576 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.627801 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.627887 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.628106 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.628201 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.628411 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.628507 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.628718 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.628804 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.629024 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.629119 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.629331 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.629419 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.629636 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.629773 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.629937 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.630042 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.630275 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.630378 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.630576 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.630663 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.630882 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.630970 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.631190 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.631275 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.631496 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.631583 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.631800 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.631888 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.632108 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.632195 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.632434 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.632520 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.632754 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.632848 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.633056 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.633143 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.633377 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.633471 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.633693 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.633811 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.634007 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.634105 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.634341 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.634455 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.634689 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.634781 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.634966 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.635061 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.635277 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.635379 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.635584 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.635673 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.635895 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.635991 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.636203 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.636299 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.636515 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.636602 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.636826 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.636912 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.637136 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.637224 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.637456 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.637550 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.637779 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.637874 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.638085 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.638172 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.638431 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.638519 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.638754 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.638842 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.639075 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.639165 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.640078 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.640262 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.640408 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.640506 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.640770 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.640901 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.641092 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.641179 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.641404 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.641500 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.641709 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.641797 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.641951 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 20:14:13.642041 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.642354 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.642681 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.643001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.643331 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.643660 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.643976 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.644300 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.644628 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.644978 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.645296 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.645639 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.645975 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.646311 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.646630 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.646940 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:14:13.647185 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 20:14:13.700952 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO dbcounter [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Registered counter for database nova_api May 26 20:14:13.707426 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO dbcounter [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] Registered counter for database nova_api May 26 20:14:13.722124 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_db.sqlalchemy.engines [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:14:13.730132 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writer thread running {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:14:13.733804 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG oslo_db.sqlalchemy.engines [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:14:13.740613 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG dbcounter [-] [103819] Writer thread running {{(pid=103819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:14:13.793472 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.context [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb70ed8b-e1e8-410e-9682-c3cef34f17da(cell1) {{(pid=103820) load_cells /opt/stack/nova/nova/context.py:464}} May 26 20:14:13.799078 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.context [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb70ed8b-e1e8-410e-9682-c3cef34f17da(cell1) {{(pid=103819) load_cells /opt/stack/nova/nova/context.py:464}} May 26 20:14:13.799223 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:14:13.800803 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:14:13.801629 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:14:13.803237 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG oslo_concurrency.lockutils [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:14:13.803620 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:14:13.804827 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG oslo_concurrency.lockutils [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:14:13.805632 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG oslo_concurrency.lockutils [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:14:13.805737 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO dbcounter [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Registered counter for database nova_cell0 May 26 20:14:13.807627 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG oslo_concurrency.lockutils [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:14:13.809869 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO dbcounter [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Registered counter for database nova_cell1 May 26 20:14:13.809980 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO dbcounter [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] Registered counter for database nova_cell0 May 26 20:14:13.815400 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO dbcounter [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] Registered counter for database nova_cell1 May 26 20:14:13.818761 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_db.sqlalchemy.engines [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:14:13.824878 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_db.sqlalchemy.engines [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:14:13.825064 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG oslo_db.sqlalchemy.engines [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:14:13.826090 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG oslo_db.sqlalchemy.engines [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:14:13.829025 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writer thread running {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:14:13.830513 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writer thread running {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:14:13.831915 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG dbcounter [-] [103819] Writer thread running {{(pid=103819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:14:13.834646 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG dbcounter [-] [103819] Writer thread running {{(pid=103819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:14:13.980667 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO dbcounter [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Registered counter for database nova_cell0 May 26 20:14:13.985790 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO dbcounter [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] Registered counter for database nova_cell0 May 26 20:14:13.989745 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_db.sqlalchemy.engines [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:14:13.994033 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writer thread running {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:14:13.994287 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG oslo_db.sqlalchemy.engines [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:14:13.998549 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG dbcounter [-] [103819] Writer thread running {{(pid=103819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:14:14.417403 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: WARNING keystonemiddleware.auth_token [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 20:14:14.425301 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: WARNING keystonemiddleware.auth_token [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 20:14:14.463422 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: WARNING keystonemiddleware.auth_token [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 20:14:14.471819 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: WARNING keystonemiddleware.auth_token [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 20:14:14.770111 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: WARNING keystonemiddleware.auth_token [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 20:14:14.776038 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: WARNING keystonemiddleware.auth_token [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 20:14:14.782020 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fae0b709c0 pid: 103820 (default app) May 26 20:14:14.784132 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:14:14.785339 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001771 May 26 20:14:14.785745 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Thu May 26 20:14:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:14:14.826154 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: WARNING keystonemiddleware.auth_token [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 20:14:14.832745 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: WARNING keystonemiddleware.auth_token [None req-cb270fa4-fe98-444e-b91e-68a6df5ce0cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 20:14:14.837980 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fae0b709c0 pid: 103819 (default app) May 26 20:15:36.006518 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:15:36.007529 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 May 26 20:15:36.007929 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:15:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:15:36.021234 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG dbcounter [-] [103819] Writing DB stats nova_api:SELECT=3 {{(pid=103819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:36.022140 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG dbcounter [-] [103819] Writing DB stats nova_cell0:SELECT=3 {{(pid=103819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:36.023097 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG dbcounter [-] [103819] Writing DB stats nova_cell1:SELECT=3 {{(pid=103819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:36.024171 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG dbcounter [-] [103819] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:36.470025 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-afaa551c-8eee-4188-9bc3-0d5a4b00709b admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:15:36.500688 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-afaa551c-8eee-4188-9bc3-0d5a4b00709b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.485006 May 26 20:15:36.502329 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Thu May 26 20:15:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:15:38.828200 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:15:38.829530 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-6292d08c-3da6-49ed-94d4-d8603cd42c71 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001741 May 26 20:15:38.830148 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:15:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:15:38.889547 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-9b3da88d-3f60-47c3-9f72-6e5f961112a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:38.914363 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 20:15:38.914363 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: warnings.warn(msg) May 26 20:15:39.017684 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-9b3da88d-3f60-47c3-9f72-6e5f961112a9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.181331 May 26 20:15:39.018484 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Thu May 26 20:15:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:15:39.032103 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_api:SELECT=3 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:39.033619 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_cell0:SELECT=3 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:39.034728 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_cell1:SELECT=3 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:39.035635 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:39.245376 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-c65763d5-85d0-482a-9e2d-07b5f00e4484 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:39.248480 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 20:15:39.248480 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: warnings.warn(msg) May 26 20:15:39.422492 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-c65763d5-85d0-482a-9e2d-07b5f00e4484 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.395700 May 26 20:15:39.423269 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Thu May 26 20:15:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:15:41.702349 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-9b3da88d-3f60-47c3-9f72-6e5f961112a9 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:15:41.703474 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-9b3da88d-3f60-47c3-9f72-6e5f961112a9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 May 26 20:15:41.703927 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:15:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:15:41.819185 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-a666c3d4-e20f-4124-8d5e-19f4bf04362c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:41.837855 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 20:15:41.837855 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: warnings.warn(msg) May 26 20:15:41.911634 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-a666c3d4-e20f-4124-8d5e-19f4bf04362c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.201140 May 26 20:15:41.912187 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Thu May 26 20:15:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:15:41.924267 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-7c00ca30-2497-4fd5-a15f-f23e7f8d9fc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:41.925831 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 20:15:41.925831 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: warnings.warn(msg) May 26 20:15:42.029025 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-7c00ca30-2497-4fd5-a15f-f23e7f8d9fc0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108442 May 26 20:15:42.029779 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Thu May 26 20:15:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:15:44.350617 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-a666c3d4-e20f-4124-8d5e-19f4bf04362c admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:15:44.352330 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-a666c3d4-e20f-4124-8d5e-19f4bf04362c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002328 May 26 20:15:44.352947 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:15:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:15:44.422721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-5cb97f58-f1b7-4deb-9cbb-1f6531a6111a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "vcpus": 1, "swap": 0}} {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:44.548272 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-5cb97f58-f1b7-4deb-9cbb-1f6531a6111a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.187694 May 26 20:15:44.548783 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Thu May 26 20:15:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:15:44.563085 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-0e79a27b-ec77-42a4-9902-11d503726f16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:44.671236 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-0e79a27b-ec77-42a4-9902-11d503726f16 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112242 May 26 20:15:44.671824 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Thu May 26 20:15:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:15:47.012051 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-5cb97f58-f1b7-4deb-9cbb-1f6531a6111a admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:15:47.013133 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-5cb97f58-f1b7-4deb-9cbb-1f6531a6111a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 May 26 20:15:47.013736 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:15:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:15:47.075923 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-740eb71b-2773-40bf-9685-0c38fc6abe54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "ram": 2048}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:47.160516 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-740eb71b-2773-40bf-9685-0c38fc6abe54 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140571 May 26 20:15:47.161099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Thu May 26 20:15:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:15:47.174132 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-8d098d7f-4e51-4fc0-bc3d-a3a61ecfe0bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:47.280559 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-8d098d7f-4e51-4fc0-bc3d-a3a61ecfe0bd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110232 May 26 20:15:47.281142 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Thu May 26 20:15:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:15:49.573278 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-740eb71b-2773-40bf-9685-0c38fc6abe54 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:15:49.575063 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-740eb71b-2773-40bf-9685-0c38fc6abe54 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 26 20:15:49.575707 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:15:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:15:49.635853 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-bbb5ae83-1ec9-476f-beed-7ae06a7a2901 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "ram": 4096, "id": "d4", "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:49.742746 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-bbb5ae83-1ec9-476f-beed-7ae06a7a2901 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.161280 May 26 20:15:49.743551 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Thu May 26 20:15:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:15:49.755654 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-05f009de-6129-42d8-95cc-2c8bd907e1e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:49.849379 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-05f009de-6129-42d8-95cc-2c8bd907e1e3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097226 May 26 20:15:49.862270 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Thu May 26 20:15:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:15:52.124825 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-bbb5ae83-1ec9-476f-beed-7ae06a7a2901 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:15:52.125876 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-bbb5ae83-1ec9-476f-beed-7ae06a7a2901 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 26 20:15:52.126436 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:15:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:15:52.192394 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-adcce864-8f10-4d8b-abf2-9af22b565f29 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:15:52.220196 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-adcce864-8f10-4d8b-abf2-9af22b565f29 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.087086 May 26 20:15:52.220862 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Thu May 26 20:15:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:15:54.554017 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-bbb5ae83-1ec9-476f-beed-7ae06a7a2901 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:15:54.555084 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-bbb5ae83-1ec9-476f-beed-7ae06a7a2901 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 26 20:15:54.555483 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:15:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:15:54.615579 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-f044db74-5c39-466c-94a4-50fd8e41fd64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:54.744537 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-f044db74-5c39-466c-94a4-50fd8e41fd64 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.183009 May 26 20:15:54.745014 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Thu May 26 20:15:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:15:54.757392 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-8bc0b35e-7715-4fe3-848a-ee353d7b5064 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:54.846176 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-8bc0b35e-7715-4fe3-848a-ee353d7b5064 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092476 May 26 20:15:54.846799 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Thu May 26 20:15:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:15:57.110323 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-f044db74-5c39-466c-94a4-50fd8e41fd64 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:15:57.111272 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-f044db74-5c39-466c-94a4-50fd8e41fd64 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 26 20:15:57.111668 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:15:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:15:57.179689 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-ccc6bf32-1915-417d-ba22-562f985a04a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "2", "os-flavor-access:is_public": true}} {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:57.270334 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-ccc6bf32-1915-417d-ba22-562f985a04a8 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.152773 May 26 20:15:57.270881 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Thu May 26 20:15:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:15:57.285533 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-85039e2a-faff-4816-bc02-a11e5ff56b5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:57.377943 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-85039e2a-faff-4816-bc02-a11e5ff56b5d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095957 May 26 20:15:57.378518 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Thu May 26 20:15:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:15:59.652620 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-ccc6bf32-1915-417d-ba22-562f985a04a8 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:15:59.655439 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-ccc6bf32-1915-417d-ba22-562f985a04a8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003284 May 26 20:15:59.655921 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:15:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:15:59.717502 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-98bbbfe0-ded8-4a03-8d66-83f05b31f97a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:59.792738 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-98bbbfe0-ded8-4a03-8d66-83f05b31f97a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.129283 May 26 20:15:59.793311 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Thu May 26 20:15:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:15:59.809978 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-7c32d9b2-47f1-4dc3-8b39-2b8668dbe090 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:15:59.900645 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-7c32d9b2-47f1-4dc3-8b39-2b8668dbe090 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096091 May 26 20:15:59.901193 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Thu May 26 20:15:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:16:02.179090 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-98bbbfe0-ded8-4a03-8d66-83f05b31f97a admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:02.180087 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-98bbbfe0-ded8-4a03-8d66-83f05b31f97a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 26 20:16:02.180484 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:16:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:16:02.239192 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-ea6f1487-f09c-48f3-93bb-969063df24b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "id": "4", "swap": 0}} {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:16:02.354482 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-ea6f1487-f09c-48f3-93bb-969063df24b4 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.166852 May 26 20:16:02.358277 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Thu May 26 20:16:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 20:16:02.367327 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-024f9f12-2f71-41b9-9ac1-b799afc52dfd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:16:02.440260 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-024f9f12-2f71-41b9-9ac1-b799afc52dfd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076640 May 26 20:16:02.442878 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Thu May 26 20:16:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:16:04.737951 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-ea6f1487-f09c-48f3-93bb-969063df24b4 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:04.739018 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-ea6f1487-f09c-48f3-93bb-969063df24b4 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 26 20:16:04.739428 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:16:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:16:04.811810 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-05389e9a-8912-4e26-b646-ed6a1c195cf5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 160, "name": "m1.xlarge", "id": "5"}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:16:05.188977 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-05389e9a-8912-4e26-b646-ed6a1c195cf5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.443672 May 26 20:16:05.189449 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Thu May 26 20:16:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:16:05.201206 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-c10430c4-9461-45c5-b8cc-d58675974cda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:16:05.331945 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-c10430c4-9461-45c5-b8cc-d58675974cda admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.134313 May 26 20:16:05.332899 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Thu May 26 20:16:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:16:29.847900 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-05389e9a-8912-4e26-b646-ed6a1c195cf5 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:29.848899 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-05389e9a-8912-4e26-b646-ed6a1c195cf5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 26 20:16:29.849290 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:16:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:16:29.860561 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG dbcounter [-] [103819] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:16:29.908780 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-c5208024-424d-4023-91dd-615c56fefef6 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:29.926559 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-c5208024-424d-4023-91dd-615c56fefef6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071173 May 26 20:16:29.927093 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Thu May 26 20:16:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:16:30.929272 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-05389e9a-8912-4e26-b646-ed6a1c195cf5 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:30.930304 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-05389e9a-8912-4e26-b646-ed6a1c195cf5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 26 20:16:30.930699 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Thu May 26 20:16:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:16:31.132090 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-2a788fe4-2cbb-4a00-9396-70feeedbb44e admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:31.137833 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.wsgi [None req-2a788fe4-2cbb-4a00-9396-70feeedbb44e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-2a788fe4-2cbb-4a00-9396-70feeedbb44e admin admin] Request method failure captured: May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Accept: application/json May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Accept-Encoding: gzip, deflate May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Connection: keep-alive May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Content-Length: 0 May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Host: 10.222.0.44 May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Openstack-Api-Version: compute 2.90 May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Openstack-System-Scope: None May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: User-Agent: python-novaclient May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Auth-Token: gAAAAABij-AeDtHnYqp_J_6UHlIhAU5R__h-Y6v-1vyMoyFYOUUj4mKaUkGeRjGq6BQn33a62YWKou0nuzA4pqwoDiSmvJZvciU0G2DHd-_3IG_NQxq1TrN0lc9H8rR6sfD4THvu4x8bq8vMsB_Up19L84JTAsB1p5rXjNnwTgABjb_Wqe341h0 May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Domain-Id: None May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Domain-Name: None May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Identity-Status: Confirmed May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Is-Admin-Project: True May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Openstack-Nova-Api-Version: 2.90 May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Project-Domain-Id: default May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Project-Domain-Name: Default May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Project-Id: 0d411149857a41f48b504f7bf718880e May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Project-Name: admin May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Role: reader,admin,member May 26 20:16:31.141006 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Roles: reader,admin,member May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d411149857a41f48b504f7bf718880e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d411149857a41f48b504f7bf718880e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d411149857a41f48b504f7bf718880e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d411149857a41f48b504f7bf718880e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Tenant: admin May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Tenant-Id: 0d411149857a41f48b504f7bf718880e May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Tenant-Name: admin May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User: admin May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User-Domain-Id: default May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User-Domain-Name: Default May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User-Id: eb91fc48ccbc4045b34fe7c8bcf4c8b0 May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User-Name: admin May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: method: > May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: exception: Flavor 42 could not be found. May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: action_args: {'id': '42'} May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:16:31.142752 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:16:31.143792 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:31.144974 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-2a788fe4-2cbb-4a00-9396-70feeedbb44e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:16:31.146058 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-2a788fe4-2cbb-4a00-9396-70feeedbb44e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063004 May 26 20:16:31.146058 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Thu May 26 20:16:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 20:16:31.152295 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-acf9dd21-43f5-4374-94bd-cfcde267fef0 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:31.155255 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:16:31.174804 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-acf9dd21-43f5-4374-94bd-cfcde267fef0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026288 May 26 20:16:31.181565 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Thu May 26 20:16:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:16:31.186702 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-5fc3d618-7214-4d2b-a30e-34ccc0b5ed3d admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:31.208251 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-5fc3d618-7214-4d2b-a30e-34ccc0b5ed3d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027004 May 26 20:16:31.208790 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Thu May 26 20:16:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:16:31.219216 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-87167c03-32b7-4719-9695-41e132a329c2 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:31.225297 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.wsgi [None req-87167c03-32b7-4719-9695-41e132a329c2 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-87167c03-32b7-4719-9695-41e132a329c2 admin admin] Request method failure captured: May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Accept: application/json May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Accept-Encoding: gzip, deflate May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Connection: keep-alive May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Content-Length: 0 May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Host: 10.222.0.44 May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Openstack-Api-Version: compute 2.90 May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Openstack-System-Scope: None May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: User-Agent: python-novaclient May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Auth-Token: gAAAAABij-AeDtHnYqp_J_6UHlIhAU5R__h-Y6v-1vyMoyFYOUUj4mKaUkGeRjGq6BQn33a62YWKou0nuzA4pqwoDiSmvJZvciU0G2DHd-_3IG_NQxq1TrN0lc9H8rR6sfD4THvu4x8bq8vMsB_Up19L84JTAsB1p5rXjNnwTgABjb_Wqe341h0 May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Domain-Id: None May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Domain-Name: None May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Identity-Status: Confirmed May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Is-Admin-Project: True May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Openstack-Nova-Api-Version: 2.90 May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Project-Domain-Id: default May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Project-Domain-Name: Default May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Project-Id: 0d411149857a41f48b504f7bf718880e May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Project-Name: admin May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Role: reader,admin,member May 26 20:16:31.228540 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Roles: reader,admin,member May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d411149857a41f48b504f7bf718880e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d411149857a41f48b504f7bf718880e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d411149857a41f48b504f7bf718880e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d411149857a41f48b504f7bf718880e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Tenant: admin May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Tenant-Id: 0d411149857a41f48b504f7bf718880e May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Tenant-Name: admin May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User: admin May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User-Domain-Id: default May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User-Domain-Name: Default May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User-Id: eb91fc48ccbc4045b34fe7c8bcf4c8b0 May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User-Name: admin May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: method: > May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: exception: Flavor 42 could not be found. May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: action_args: {'id': '42'} May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:16:31.231932 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:16:31.232820 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:31.234099 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-87167c03-32b7-4719-9695-41e132a329c2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:16:31.235414 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-87167c03-32b7-4719-9695-41e132a329c2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014934 May 26 20:16:31.235414 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Thu May 26 20:16:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 20:16:32.095247 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-5fc3d618-7214-4d2b-a30e-34ccc0b5ed3d admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:32.096246 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-5fc3d618-7214-4d2b-a30e-34ccc0b5ed3d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 26 20:16:32.096651 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Thu May 26 20:16:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:16:32.284503 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-76ae83bc-beff-4453-baf3-919db813c55b admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:32.289778 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.wsgi [None req-76ae83bc-beff-4453-baf3-919db813c55b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-76ae83bc-beff-4453-baf3-919db813c55b admin admin] Request method failure captured: May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Accept: application/json May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Accept-Encoding: gzip, deflate May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Connection: keep-alive May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Content-Length: 0 May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Host: 10.222.0.44 May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Openstack-Api-Version: compute 2.90 May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Openstack-System-Scope: None May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: User-Agent: python-novaclient May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Auth-Token: gAAAAABij-Agi_-DQGcvfYOuAF0xFQQyC-r5oMRr4FzR-j_IsfaTcFmHammC5WfFmqcET3h1atw6XyMt-S5j8QbQUvYm5Lq605lJOZ0065fSRGoydJR_yjEiDqvWCweXf-tijC2Zzj8W8rSpMiKqqgvOEK-5kRU3K4WdjFsytseZUcxtTe4Pbd0 May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Domain-Id: None May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Domain-Name: None May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Identity-Status: Confirmed May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Is-Admin-Project: True May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Openstack-Nova-Api-Version: 2.90 May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Project-Domain-Id: default May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Project-Domain-Name: Default May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Project-Id: 0d411149857a41f48b504f7bf718880e May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Project-Name: admin May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Role: reader,admin,member May 26 20:16:32.291366 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Roles: reader,admin,member May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d411149857a41f48b504f7bf718880e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d411149857a41f48b504f7bf718880e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d411149857a41f48b504f7bf718880e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d411149857a41f48b504f7bf718880e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Tenant: admin May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Tenant-Id: 0d411149857a41f48b504f7bf718880e May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Tenant-Name: admin May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User: admin May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User-Domain-Id: default May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User-Domain-Name: Default May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User-Id: eb91fc48ccbc4045b34fe7c8bcf4c8b0 May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User-Name: admin May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: method: > May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: exception: Flavor 84 could not be found. May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: action_args: {'id': '84'} May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:16:32.293315 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:16:32.294385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:32.295757 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-76ae83bc-beff-4453-baf3-919db813c55b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:16:32.297192 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-76ae83bc-beff-4453-baf3-919db813c55b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060547 May 26 20:16:32.297192 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Thu May 26 20:16:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 20:16:32.302565 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-81f10276-8cc4-4ad3-af0c-b47565ebe377 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:32.318452 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-81f10276-8cc4-4ad3-af0c-b47565ebe377 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019305 May 26 20:16:32.318978 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Thu May 26 20:16:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:16:32.329274 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-018f3e32-d2a6-4b35-8339-3b810c272ebc admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:32.343404 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-018f3e32-d2a6-4b35-8339-3b810c272ebc admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018025 May 26 20:16:32.343941 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Thu May 26 20:16:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:16:32.353120 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-98bd0b2e-15a7-4104-92ff-e834005c75c2 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:32.359497 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.wsgi [None req-98bd0b2e-15a7-4104-92ff-e834005c75c2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-98bd0b2e-15a7-4104-92ff-e834005c75c2 admin admin] Request method failure captured: May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Accept: application/json May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Accept-Encoding: gzip, deflate May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Connection: keep-alive May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Content-Length: 0 May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Host: 10.222.0.44 May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Openstack-Api-Version: compute 2.90 May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Openstack-System-Scope: None May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: User-Agent: python-novaclient May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Auth-Token: gAAAAABij-Agi_-DQGcvfYOuAF0xFQQyC-r5oMRr4FzR-j_IsfaTcFmHammC5WfFmqcET3h1atw6XyMt-S5j8QbQUvYm5Lq605lJOZ0065fSRGoydJR_yjEiDqvWCweXf-tijC2Zzj8W8rSpMiKqqgvOEK-5kRU3K4WdjFsytseZUcxtTe4Pbd0 May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Domain-Id: None May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Domain-Name: None May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Identity-Status: Confirmed May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Is-Admin-Project: True May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Openstack-Nova-Api-Version: 2.90 May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Project-Domain-Id: default May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Project-Domain-Name: Default May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Project-Id: 0d411149857a41f48b504f7bf718880e May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Project-Name: admin May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Role: reader,admin,member May 26 20:16:32.361001 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Roles: reader,admin,member May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d411149857a41f48b504f7bf718880e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d411149857a41f48b504f7bf718880e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d411149857a41f48b504f7bf718880e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d411149857a41f48b504f7bf718880e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Tenant: admin May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Tenant-Id: 0d411149857a41f48b504f7bf718880e May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Tenant-Name: admin May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User: admin May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User-Domain-Id: default May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User-Domain-Name: Default May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User-Id: eb91fc48ccbc4045b34fe7c8bcf4c8b0 May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User-Name: admin May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: method: > May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: exception: Flavor 84 could not be found. May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: action_args: {'id': '84'} May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:16:32.362596 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:16:32.363582 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:32.364721 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-98bd0b2e-15a7-4104-92ff-e834005c75c2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:16:32.365731 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-98bd0b2e-15a7-4104-92ff-e834005c75c2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012780 May 26 20:16:32.365731 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Thu May 26 20:16:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 20:16:33.227307 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-018f3e32-d2a6-4b35-8339-3b810c272ebc admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:33.228305 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-018f3e32-d2a6-4b35-8339-3b810c272ebc admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 26 20:16:33.228952 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Thu May 26 20:16:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:16:33.418022 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-fdd4aa6f-9cdb-4105-8164-e257e177943f admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:33.423735 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.wsgi [None req-fdd4aa6f-9cdb-4105-8164-e257e177943f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-fdd4aa6f-9cdb-4105-8164-e257e177943f admin admin] Request method failure captured: May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Accept: application/json May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Accept-Encoding: gzip, deflate May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Connection: keep-alive May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Content-Length: 0 May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Host: 10.222.0.44 May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Openstack-Api-Version: compute 2.90 May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Openstack-System-Scope: None May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: User-Agent: python-novaclient May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Auth-Token: gAAAAABij-Ah0rFkEGgbMj5XlMLI71eJkljRhYQVOtG-Ue_fTZC5uuENsqbaFceV_wdae63BYuMc3X0TdzZjszZR0RBHjSyrnYVLfACPANeuoTPVbwggef9sj-5mYczvK0EnuEdNruVdjVtMsz0xydLjrLsXcUxgt6DG8EGNBEYxttek_Qno7c0 May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Domain-Id: None May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Domain-Name: None May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Identity-Status: Confirmed May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Is-Admin-Project: True May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Openstack-Nova-Api-Version: 2.90 May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Project-Domain-Id: default May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Project-Domain-Name: Default May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Project-Id: 0d411149857a41f48b504f7bf718880e May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Project-Name: admin May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Role: reader,admin,member May 26 20:16:33.425230 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Roles: reader,admin,member May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d411149857a41f48b504f7bf718880e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d411149857a41f48b504f7bf718880e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d411149857a41f48b504f7bf718880e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d411149857a41f48b504f7bf718880e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Tenant: admin May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Tenant-Id: 0d411149857a41f48b504f7bf718880e May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-Tenant-Name: admin May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User: admin May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User-Domain-Id: default May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User-Domain-Name: Default May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User-Id: eb91fc48ccbc4045b34fe7c8bcf4c8b0 May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: X-User-Name: admin May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: method: > May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: exception: Flavor 451 could not be found. May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: action_args: {'id': '451'} May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:16:33.426784 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:16:33.427747 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: ERROR nova.api.openstack.wsgi May 26 20:16:33.429141 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-fdd4aa6f-9cdb-4105-8164-e257e177943f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:16:33.430399 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-fdd4aa6f-9cdb-4105-8164-e257e177943f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061190 May 26 20:16:33.430399 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Thu May 26 20:16:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 20:16:33.436394 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-c834c407-6c89-4a45-97a1-1eea942bfc20 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:33.451791 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-c834c407-6c89-4a45-97a1-1eea942bfc20 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019147 May 26 20:16:33.452302 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Thu May 26 20:16:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:16:33.461426 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:33.475454 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017517 May 26 20:16:33.475971 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Thu May 26 20:16:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:16:33.485147 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-abfebc99-a496-493e-af9d-9160b3066a52 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:33.490458 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.wsgi [None req-abfebc99-a496-493e-af9d-9160b3066a52 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-abfebc99-a496-493e-af9d-9160b3066a52 admin admin] Request method failure captured: May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Accept: application/json May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Accept-Encoding: gzip, deflate May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Connection: keep-alive May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Content-Length: 0 May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Host: 10.222.0.44 May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Openstack-Api-Version: compute 2.90 May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Openstack-System-Scope: None May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: User-Agent: python-novaclient May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Auth-Token: gAAAAABij-Ah0rFkEGgbMj5XlMLI71eJkljRhYQVOtG-Ue_fTZC5uuENsqbaFceV_wdae63BYuMc3X0TdzZjszZR0RBHjSyrnYVLfACPANeuoTPVbwggef9sj-5mYczvK0EnuEdNruVdjVtMsz0xydLjrLsXcUxgt6DG8EGNBEYxttek_Qno7c0 May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Domain-Id: None May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Domain-Name: None May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Identity-Status: Confirmed May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Is-Admin-Project: True May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Openstack-Nova-Api-Version: 2.90 May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Project-Domain-Id: default May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Project-Domain-Name: Default May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Project-Id: 0d411149857a41f48b504f7bf718880e May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Project-Name: admin May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Role: reader,admin,member May 26 20:16:33.491939 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Roles: reader,admin,member May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d411149857a41f48b504f7bf718880e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d411149857a41f48b504f7bf718880e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d411149857a41f48b504f7bf718880e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d411149857a41f48b504f7bf718880e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Tenant: admin May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Tenant-Id: 0d411149857a41f48b504f7bf718880e May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-Tenant-Name: admin May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User: admin May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User-Domain-Id: default May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User-Domain-Name: Default May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User-Id: eb91fc48ccbc4045b34fe7c8bcf4c8b0 May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: X-User-Name: admin May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: method: > May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: exception: Flavor 451 could not be found. May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: action_args: {'id': '451'} May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:16:33.493528 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:16:33.494666 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi May 26 20:16:33.496758 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-abfebc99-a496-493e-af9d-9160b3066a52 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:16:33.498005 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-abfebc99-a496-493e-af9d-9160b3066a52 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011622 May 26 20:16:33.498005 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Thu May 26 20:16:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 20:16:34.365767 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:34.366805 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 May 26 20:16:34.367195 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Thu May 26 20:16:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:16:34.563982 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-9729cb50-b78f-42b2-9cff-34184afce672 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:16:34.651497 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-9729cb50-b78f-42b2-9cff-34184afce672 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.140630 May 26 20:16:34.652037 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Thu May 26 20:16:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:16:35.515885 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:35.516914 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 26 20:16:35.517308 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Thu May 26 20:16:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:16:35.705558 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-7c3e992a-e0e9-433c-b7d4-bedb10d38895 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:16:35.786612 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-7c3e992a-e0e9-433c-b7d4-bedb10d38895 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.132810 May 26 20:16:35.787091 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Thu May 26 20:16:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:16:36.662943 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:36.663953 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 26 20:16:36.664345 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Thu May 26 20:16:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:16:36.857915 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-b96c500c-4786-4a72-a4a7-523763e9cb04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:16:36.937652 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-b96c500c-4786-4a72-a4a7-523763e9cb04 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.133100 May 26 20:16:36.938191 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Thu May 26 20:16:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:16:37.820610 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:37.821612 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 26 20:16:37.822002 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Thu May 26 20:16:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:16:38.015225 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-5e1b0da2-e42b-47b7-9672-dce7397c98ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:16:38.120801 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-5e1b0da2-e42b-47b7-9672-dce7397c98ef admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.158111 May 26 20:16:38.121472 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Thu May 26 20:16:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:16:39.019640 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:39.020648 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 26 20:16:39.021044 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Thu May 26 20:16:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:16:39.213060 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-30d5afcc-f95e-44fa-9473-ca52102c4f7d admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:16:39.232989 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-30d5afcc-f95e-44fa-9473-ca52102c4f7d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076229 May 26 20:16:39.233522 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Thu May 26 20:16:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:17:41.840643 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:17:41.841685 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-96778638-ccf2-4b14-b8df-8ac70aa9f19d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 26 20:17:41.842083 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Thu May 26 20:17:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:17:41.849674 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:17:41.905629 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-1bb10752-43cb-4109-b622-b6171eefc2ae admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:17:41.927090 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-1bb10752-43cb-4109-b622-b6171eefc2ae admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078736 May 26 20:17:41.927640 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Thu May 26 20:17:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:17:41.949217 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG dbcounter [-] [103819] Writing DB stats nova_api:SELECT=14 {{(pid=103819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:17:41.952959 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-5db0daee-e625-42eb-85b2-5698e4177f0f admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:17:41.960576 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-5db0daee-e625-42eb-85b2-5698e4177f0f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012899 May 26 20:17:41.962123 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Thu May 26 20:17:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:17:41.972625 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-a86e0267-2e8e-4c9d-9e87-7ef109fa4e0c admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:17:41.981088 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-a86e0267-2e8e-4c9d-9e87-7ef109fa4e0c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012055 May 26 20:17:41.981599 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Thu May 26 20:17:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:17:41.992938 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-ab801c24-be80-4878-aad1-b972e805b776 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:17:42.001297 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-ab801c24-be80-4878-aad1-b972e805b776 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012179 May 26 20:17:42.001812 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Thu May 26 20:17:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:17:42.014720 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-0922ce21-2b58-4805-ba2b-e6ec10b68356 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:17:42.022235 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-0922ce21-2b58-4805-ba2b-e6ec10b68356 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011059 May 26 20:17:42.022783 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Thu May 26 20:17:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:21:27.961154 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-ab801c24-be80-4878-aad1-b972e805b776 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:21:27.962176 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-ab801c24-be80-4878-aad1-b972e805b776 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 26 20:21:27.962639 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Thu May 26 20:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:21:28.123011 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_api:SELECT=6 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:21:28.243381 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-f92efffd-8d31-4afc-b5fa-52d5adb5fe57 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:21:28.244612 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 20:21:28.244612 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: warnings.warn(msg) May 26 20:21:28.245818 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-f92efffd-8d31-4afc-b5fa-52d5adb5fe57 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:21:28.246281 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-f92efffd-8d31-4afc-b5fa-52d5adb5fe57 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:21:28.247162 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-f92efffd-8d31-4afc-b5fa-52d5adb5fe57 admin admin] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:21:28.247596 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-f92efffd-8d31-4afc-b5fa-52d5adb5fe57 admin admin] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:21:28.280989 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-f92efffd-8d31-4afc-b5fa-52d5adb5fe57 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.159552 May 26 20:21:28.281536 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Thu May 26 20:21:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 20:21:29.161064 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-ab801c24-be80-4878-aad1-b972e805b776 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:21:29.162092 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-ab801c24-be80-4878-aad1-b972e805b776 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 26 20:21:29.162510 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Thu May 26 20:21:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:21:29.352454 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-757fe50a-9696-4e73-b247-2df94e240cf7 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:21:29.353673 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 20:21:29.353673 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: warnings.warn(msg) May 26 20:21:29.354909 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-757fe50a-9696-4e73-b247-2df94e240cf7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:21:29.355469 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-757fe50a-9696-4e73-b247-2df94e240cf7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:21:29.356771 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-757fe50a-9696-4e73-b247-2df94e240cf7 admin admin] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:21:29.357389 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-757fe50a-9696-4e73-b247-2df94e240cf7 admin admin] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:21:29.377385 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-757fe50a-9696-4e73-b247-2df94e240cf7 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079487 May 26 20:21:29.377927 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Thu May 26 20:21:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:21:40.687465 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-ab801c24-be80-4878-aad1-b972e805b776 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:21:40.688468 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-ab801c24-be80-4878-aad1-b972e805b776 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 26 20:21:40.688862 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Thu May 26 20:21:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:21:40.838115 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_cell0:SELECT=4 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:21:40.838943 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_cell1:SELECT=4 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:21:40.839574 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_api:SELECT=8 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:21:40.888963 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-3ecf9499-721f-45be-ae55-a257f6620bac admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:21:40.890148 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 20:21:40.890148 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: warnings.warn(msg) May 26 20:21:40.891375 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-3ecf9499-721f-45be-ae55-a257f6620bac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:21:40.895637 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-3ecf9499-721f-45be-ae55-a257f6620bac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:21:40.895637 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-3ecf9499-721f-45be-ae55-a257f6620bac admin admin] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:21:40.895637 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-3ecf9499-721f-45be-ae55-a257f6620bac admin admin] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:21:40.919815 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-3ecf9499-721f-45be-ae55-a257f6620bac admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087013 May 26 20:21:40.920384 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Thu May 26 20:21:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:21:41.797220 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: DEBUG nova.api.openstack.wsgi [None req-ab801c24-be80-4878-aad1-b972e805b776 admin admin] Calling method '>' {{(pid=103819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:21:41.798221 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: INFO nova.api.openstack.requestlog [None req-ab801c24-be80-4878-aad1-b972e805b776 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 26 20:21:41.798670 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: [pid: 103819|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Thu May 26 20:21:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:21:41.991698 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-178e0117-358c-4931-accc-c48f3d887d34 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:21:41.992903 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 20:21:41.992903 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: warnings.warn(msg) May 26 20:21:41.994138 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-178e0117-358c-4931-accc-c48f3d887d34 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:21:41.994617 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-178e0117-358c-4931-accc-c48f3d887d34 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:21:41.995415 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-178e0117-358c-4931-accc-c48f3d887d34 admin admin] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:21:41.995844 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-178e0117-358c-4931-accc-c48f3d887d34 admin admin] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:21:42.017993 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-178e0117-358c-4931-accc-c48f3d887d34 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079731 May 26 20:21:42.018593 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Thu May 26 20:21:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:22:38.574840 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: Thu May 26 20:22:38 2022 - graceful shutdown triggered... May 26 20:22:38.580115 dv-cinder-842131-1-iscsi devstack@n-api.service[103819]: Gracefully killing worker 1 (pid: 103819)... May 26 20:22:38.574956 dv-cinder-842131-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 20:22:38.581160 dv-cinder-842131-1-iscsi devstack@n-api.service[103820]: Gracefully killing worker 2 (pid: 103820)... May 26 20:22:39.576508 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: worker 1 buried after 1 seconds May 26 20:22:39.576508 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: worker 2 buried after 1 seconds May 26 20:22:39.576508 dv-cinder-842131-1-iscsi devstack@n-api.service[103818]: goodbye to uWSGI. May 26 20:22:39.578162 dv-cinder-842131-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 20:22:39.578748 dv-cinder-842131-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 20:22:39.581425 dv-cinder-842131-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 20:22:39.601233 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 20:22:39.626312 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 20:22:39 2022] *** May 26 20:22:39.626312 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 20:22:39.626312 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 20:22:39.626312 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: nodename: dv-cinder-842131-1-iscsi May 26 20:22:39.626312 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: machine: x86_64 May 26 20:22:39.626312 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: clock source: unix May 26 20:22:39.626312 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: pcre jit disabled May 26 20:22:39.626312 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: detected number of CPU cores: 4 May 26 20:22:39.626312 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: current working directory: / May 26 20:22:39.626312 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: detected binary path: /usr/bin/uwsgi-core May 26 20:22:39.627031 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: your processes number limit is 47680 May 26 20:22:39.627031 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: your memory page size is 4096 bytes May 26 20:22:39.627031 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: detected max file descriptor number: 2048 May 26 20:22:39.627031 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: lock engine: pthread robust mutexes May 26 20:22:39.627031 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: thunder lock: enabled May 26 20:22:39.627031 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 20:22:39.627031 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 20:22:39.673331 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: Python main interpreter initialized at 0x55654ac9f9c0 May 26 20:22:39.673331 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: python threads support enabled May 26 20:22:39.673331 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: your server socket listen backlog is limited to 100 connections May 26 20:22:39.673331 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: your mercy for graceful operations on workers is 90 seconds May 26 20:22:39.673803 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: mapped 403077 bytes (393 KB) for 2 cores May 26 20:22:39.673803 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: *** Operational MODE: preforking *** May 26 20:22:39.674028 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: *** uWSGI is running in multiple interpreter mode *** May 26 20:22:39.674028 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: spawned uWSGI master process (pid: 118281) May 26 20:22:39.674258 dv-cinder-842131-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 20:22:39.675394 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: spawned uWSGI worker 1 (pid: 118306, cores: 1) May 26 20:22:39.675394 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: spawned uWSGI worker 2 (pid: 118307, cores: 1) May 26 20:22:39.675394 dv-cinder-842131-1-iscsi devstack@n-api.service[118281]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 20:22:40.862126 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 20:22:40.880042 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 20:22:41.659993 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 20:22:41.659993 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: from cryptography.utils import int_from_bytes May 26 20:22:41.660317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 20:22:41.660317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: from cryptography.utils import int_from_bytes May 26 20:22:41.684526 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 20:22:41.684526 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: from cryptography.utils import int_from_bytes May 26 20:22:41.684934 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 20:22:41.684934 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: from cryptography.utils import int_from_bytes May 26 20:22:44.143159 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 20:22:44.143734 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 20:22:44.144010 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 20:22:44.144218 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 20:22:44.144480 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 20:22:44.144882 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.145219 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.145543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.145870 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.146208 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.146561 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.146890 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.147224 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.147558 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.147825 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.148146 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.148478 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842131-1-iscsi {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.148806 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.149121 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.149437 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.149763 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.150072 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.150428 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.150745 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.151254 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.152649 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.152649 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.152649 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.152997 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.153291 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.153602 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.153923 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.154254 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.155164 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.155472 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.155890 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842131-1-iscsi {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.156217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.156540 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.156861 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.157308 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.157624 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.157943 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.158269 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.158602 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.158919 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.159253 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.159581 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.159906 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.160234 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.160541 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.160853 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.161170 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.161494 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.161806 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.162116 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.162395 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.162710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.163036 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.163366 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.163695 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.163954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.164209 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.164533 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.164858 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.165169 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.165483 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.165804 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.166109 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.166443 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.166759 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.167075 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.167388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.167709 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.168032 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.168362 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.168677 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.169004 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.169411 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.169667 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.169982 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.170488 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.170859 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.171135 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.171462 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.171797 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.172099 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.172413 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.172730 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.173057 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.175927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.175927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.175927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.175927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.175927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.175927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.175927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.175927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.177440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.177440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.177440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.177440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.177440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.177440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.178361 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.178361 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.178361 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.178791 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 20:22:44.179290 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.179445 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 20:22:44.179602 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.179602 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.179884 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 20:22:44.180049 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.180201 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 20:22:44.180361 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.180513 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 20:22:44.180665 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.180817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.180961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.181112 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.181281 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.181434 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.181579 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.181751 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.181980 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.182154 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.182330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.183845 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.184019 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.184183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.184339 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.184492 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.184644 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.184807 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.184967 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.185122 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.185281 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.185434 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.185586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.185788 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842131-1-iscsi {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.185955 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.186172 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.186358 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.186505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.186698 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.187173 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.187416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.187566 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.187720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.187875 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.188020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.188165 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.188326 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.188480 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.188632 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.188632 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.189118 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.189316 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.189466 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.189626 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.189781 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.189931 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.190087 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.190314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.190481 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.190628 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.190779 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.191004 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.191152 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.191326 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.191481 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.191626 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.191771 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.191914 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.192072 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.192228 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.192373 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.192517 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.192517 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.192816 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842131-1-iscsi {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.192970 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.193130 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.193984 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.194146 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.194146 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.194466 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.194466 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.194761 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.194918 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.195070 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.195230 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.195385 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.195538 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.195691 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.195849 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.196001 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.196156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.196302 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.196446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.196589 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.196862 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.197035 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.197193 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.197338 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.197490 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.197641 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.197795 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.197966 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.198129 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.198327 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.198487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.198639 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.198784 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.198938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.199094 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.199246 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.199396 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.199547 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.199692 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.199859 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.199859 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.200158 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.200310 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.200460 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.200612 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.200770 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.200926 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.201078 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.201230 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.201904 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.202139 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.202373 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.202530 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.202712 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.202910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.203060 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.203220 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.203385 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.204341 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.204504 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.204659 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.204805 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.204965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.204965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.205261 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.205408 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.205552 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.205728 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.205875 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.206027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.206172 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.206351 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.207097 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.207097 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.207286 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.207370 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.207451 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.207531 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.207603 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.207687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.207760 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.207830 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.207907 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.207994 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.208080 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.208080 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.208245 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.208330 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.208413 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.208413 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.208598 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.208684 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.208768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.208858 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.208942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.209024 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.209120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.209206 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.209288 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.209288 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.209452 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.209536 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.209630 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.209714 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.209803 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.209886 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.209969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.210050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.210050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.210199 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.210309 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.210394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.210477 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.210591 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.210680 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.210770 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.210854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.210937 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.211019 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.211118 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.211211 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.211295 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.211389 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.211487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.211571 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.211662 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.211746 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.211837 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.211931 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.212015 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.212098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.212193 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.212284 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.212382 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.212567 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.212656 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.212746 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.212830 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.212922 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.213014 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.213098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.213181 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.213271 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.213361 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.213453 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.213538 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.213721 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.213830 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.218317 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.218567 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.218730 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.218891 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.219040 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.219209 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.219358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.219503 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.219648 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.220070 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.220276 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.220434 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.220589 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.220741 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.220896 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.221041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.221199 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.221345 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.221499 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.221651 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.221651 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.221933 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.222092 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.222263 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.222429 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.222581 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.222733 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.222884 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.223039 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.223184 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.223345 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.223489 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.223641 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.223818 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.224328 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.224725 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.224894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.225050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.225197 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.225350 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.225503 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.225661 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.225813 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.225968 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.226122 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.226877 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.227039 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.227194 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.227342 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.227494 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.227669 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.227925 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.228090 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.228256 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.228477 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.228635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.228803 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.228949 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.229101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.229246 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.229391 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.229543 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:22:44.229702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.229861 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.230017 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.230171 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.230396 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.230552 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.230706 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.230870 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.231023 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.231167 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.231313 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.231457 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.231613 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.231759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.231909 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.232053 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.232197 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.232350 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.232496 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.232674 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.232821 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.232964 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.233106 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.233264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.233418 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.233565 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.233717 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.233868 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.234376 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.234570 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.234966 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.235117 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.235281 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.235428 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.235574 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.235727 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.235880 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.236042 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.236187 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.236331 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.236488 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.236642 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.236787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.236940 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.237085 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.237243 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.237401 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.237556 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.237702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.237845 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.238004 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.238162 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.238365 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.238601 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.238769 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.238945 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.239182 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.239345 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.239526 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.239687 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.239840 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.239998 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.240157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.240323 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.240483 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.240642 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.240795 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.240954 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.241154 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.241320 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.241482 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.241642 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.241795 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.241955 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.241955 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.242292 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.242451 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.242603 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.242753 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.242915 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.243075 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.243241 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.243241 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.243556 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.243708 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.243865 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.244026 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.244583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.244762 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.245022 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.245355 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.245514 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.245676 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.245837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.245998 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.246159 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.246356 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.246511 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.246674 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.246828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.246985 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.247138 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.247289 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.247439 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.247687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.247880 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.248037 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.248189 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.248433 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.248628 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.248862 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.249029 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.249182 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.249342 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.249502 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.249682 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.249867 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.250021 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.250178 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.250389 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.250542 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.250742 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.250910 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.251071 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.251223 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.251381 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.251533 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.251700 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.251860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.252022 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.252224 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.252386 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.252546 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.252711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.252882 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.253042 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.253194 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.253344 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.253505 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.253658 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.253816 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.253974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.253974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.254293 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.254813 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.254984 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.255208 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.255566 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.255734 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.255894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.256063 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.256216 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.256374 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.256535 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.256688 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.256846 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.257007 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.257159 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.257316 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.257467 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.257631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.257797 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.257957 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.258120 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.258302 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.258468 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.258628 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.258790 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.259031 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.259189 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.259348 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.259499 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.259661 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.259828 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.259981 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.260132 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.260289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.260500 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.260665 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.260832 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.260992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.260992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.261295 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.261455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.261455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.261774 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.261928 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.262079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.262268 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.262429 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.262592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.262751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.262905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.263062 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.263215 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.263364 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.263529 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.263680 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.264337 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.264826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.265855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.266031 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.266197 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.266384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.266548 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.266711 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.267110 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.267266 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.267428 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.267605 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.267767 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.267927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.268081 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.268241 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.268439 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.268602 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.268755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.268914 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.269161 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.269329 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.269483 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.269641 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.269818 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.269980 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.270139 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.270358 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.270527 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.270680 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.270837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.270989 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.271140 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.271301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.271301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.271597 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.271757 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.271919 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.272080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.272231 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.272383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.272533 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.272690 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.272842 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.273002 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.273161 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.273313 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.273471 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.273622 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.273783 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.273944 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.274105 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.274289 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.274446 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.275002 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.275170 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.275170 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.275487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.275666 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.276107 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.276269 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.276435 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.276608 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.276767 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.276926 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.277076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.277234 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.277399 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.277560 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.277711 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.278079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.278277 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.278450 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.278618 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.278777 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.278954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.279108 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.279487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.279759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.280433 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.280514 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.280585 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.280673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.280754 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.280834 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.280925 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281005 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281077 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281146 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281216 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281305 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281385 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281464 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281536 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281606 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281684 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281835 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281904 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.281974 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.282104 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.282201 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.282305 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.282381 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.282451 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.282521 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.282603 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.282686 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.282773 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.282846 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.282846 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.283018 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.283101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.283193 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.283279 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.283369 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.283452 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.283535 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.283617 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.283708 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.283708 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.283862 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.283952 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.284046 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.284046 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.284214 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.284299 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.284381 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.284463 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.284545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.284641 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.284760 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.285099 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.285197 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.285290 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.285374 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.285471 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.285557 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.285639 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.285729 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.285842 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.285944 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.286231 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.286353 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.286438 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.286534 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.286627 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.286755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.286856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.286943 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.287026 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.287109 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.287191 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.287287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.287287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.287449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.287546 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.287638 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.287730 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.287822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.287915 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.288007 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.288099 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.288190 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.288280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.288378 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.288470 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.288560 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.288650 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.288734 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.288825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.288922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.289014 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.289105 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.289189 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.289279 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.289375 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.289463 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.289544 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.289635 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.289720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.289803 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.289898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.289989 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.290081 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.290166 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.290289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.290388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.290487 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.290586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.290678 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.290771 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.290771 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.290938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.291038 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.291134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.291219 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.291308 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.291392 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.291484 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.291569 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.291651 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.291741 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.291826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.291909 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.292005 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.292091 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.292173 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.292256 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.292338 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.292422 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.292513 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.292598 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.292680 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.292771 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.292863 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.292947 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.293036 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.293128 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.293219 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.293311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.293403 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.293495 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.293579 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.293662 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.293750 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.293878 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.293974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.294059 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.294148 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.294232 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.294332 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.294433 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.294527 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.294619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.294704 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.294786 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.294881 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.294983 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.295278 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.295371 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.295466 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.295540 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.295623 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.295710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.295787 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.295858 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.295935 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.296006 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.296092 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.296183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.296446 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.296549 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.296635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.296726 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.296726 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.296893 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.296893 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.297052 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.297143 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.297243 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.297336 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.297421 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.297566 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.297669 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.297880 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.297991 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.298189 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.298326 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.298544 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.298644 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.298853 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.299024 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.299163 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.299262 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.299471 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.299568 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.299785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.299887 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.300097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.300190 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.300405 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.300522 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.300719 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.300820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.301033 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.301126 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.301346 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.301451 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.301660 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.301762 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.301966 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.302059 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.302300 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.302408 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.302609 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.302703 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.302928 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.303027 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.303240 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.303334 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.303552 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.303686 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.303872 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.303986 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.304172 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.304281 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.304568 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.304995 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.305344 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.305619 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.305941 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.306282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.306611 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.306922 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.307444 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.307805 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.308134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.308322 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.308509 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.308605 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.308781 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.308875 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.309104 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.309217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.309500 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.309835 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.310195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.310551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.310660 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.310910 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.311071 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.311265 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.311426 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.311561 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.311733 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.311903 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.312055 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.312241 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.312380 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.312568 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.312699 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.312903 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.313015 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.313333 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.313424 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.313670 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.313792 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.313992 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.314085 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.314326 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.314433 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.314652 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.314746 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.314969 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.315069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.315282 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.315531 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.315653 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.315748 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.315900 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.315984 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.316210 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.316307 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.316522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.316636 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.316835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.316940 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.317144 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.317236 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.317462 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.317562 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.317780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.317874 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.318092 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.318197 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.318428 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.318523 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.318747 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.318846 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.319061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.319164 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.319392 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.319486 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.319711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.319802 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.320042 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.320158 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.320373 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.320473 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.320685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.320777 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.321009 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.321109 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.321324 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.321414 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.321638 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.321731 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.321950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.322043 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.322283 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.322403 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.322607 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.322712 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.322927 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.323037 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.323243 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.323344 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.323553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.323657 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.323869 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.323974 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.324198 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.324289 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.324515 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.324606 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.324835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.324936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.325163 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.325273 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.325611 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.325726 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.325822 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.325913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.326105 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.326208 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.326960 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.327085 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.327279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.327373 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.327590 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.327688 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.327911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.328015 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.328204 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.328306 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.328520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.328626 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.328825 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.328918 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.329133 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.329234 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.329446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.329547 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.329761 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.329853 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.330076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.330222 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.330435 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.330594 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.330738 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.330879 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.331051 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.331193 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.331359 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.331652 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.331794 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.331936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.332091 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.332236 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.332384 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.332530 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.332669 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.332818 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.332964 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.333106 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.333260 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.333406 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.333572 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.333712 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.333889 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.334025 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.334214 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.334383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.334549 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.334643 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.334866 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.334959 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.335184 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.335280 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.335503 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.335609 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.335844 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.335942 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.336119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.336237 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.336440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.336539 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.336750 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.336868 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.337073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.337204 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.337394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.337567 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.337823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.337933 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.338029 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.338292 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.338391 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.338633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.338726 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.338953 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.339057 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.339275 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.339369 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.339584 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.339689 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.339902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.340010 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.340207 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.340288 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.340520 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.340674 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.340820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.340963 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.341154 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.341295 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.341445 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.341596 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.341767 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.341994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.342725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.342856 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.343065 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.343167 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.343408 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.343502 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.343732 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.343833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.344052 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.344154 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.345142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.345265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.345354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.345448 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.345448 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.345626 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.345715 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.345957 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.345957 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.346141 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.346229 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.346348 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.346540 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.346634 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.346850 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.346956 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.347165 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.347271 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.347482 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.347587 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.347798 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.347903 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.348121 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.348234 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.348434 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.348528 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.348751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.348854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.349072 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.349164 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.349398 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.349491 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.349731 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.349832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.350072 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.350165 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.350415 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.350522 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.350736 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.350864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.351053 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.351161 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.351363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.351466 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.351692 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.351888 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.351991 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.352213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.352315 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.352553 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.352663 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.352884 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.352992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.353203 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.353304 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.353510 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.353623 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.353833 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.353933 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.354140 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.354296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.354486 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.354581 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.354796 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.354898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.355114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.355208 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.355431 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.355525 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.355741 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.355839 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.356080 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.356178 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.356367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.356460 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.356671 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.356770 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.356980 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.357080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.357292 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.357392 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.357761 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.357974 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.358089 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.358437 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.358565 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.358765 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.358914 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.359105 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.359255 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.359445 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.359577 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.359773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.359920 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.360089 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.360258 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.360424 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.360611 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.360742 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.360904 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.361057 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.361236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.361383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.361549 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.361701 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.361860 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.362013 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.362182 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.362348 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.362517 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.362670 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.362829 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.362988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.363138 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.363297 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.363455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.363614 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.363765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.363926 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.364072 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.364258 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.364380 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.364568 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.364709 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.364880 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.365020 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.365190 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.365350 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.365510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.365669 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.365822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.366108 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.366225 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.366365 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.366459 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.366622 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.366759 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.366973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.367067 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.367283 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.367380 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.367626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.367742 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.367952 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.368065 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.368268 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.368379 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.368581 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.368684 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.368898 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.368991 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.369224 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.369324 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.369548 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.369642 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.369871 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.369964 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.370188 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.370313 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.370538 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.370632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.370857 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.370960 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.371175 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.371275 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.371491 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.371583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.371803 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.371904 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.372125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.372242 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.372446 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.372538 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.372765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.372988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.373848 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.373964 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.374185 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.374415 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.374568 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.374760 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.374873 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.375102 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.375205 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.375418 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.375511 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.375733 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.375835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.376049 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.376285 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.376376 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.376460 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.376666 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.376770 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.376982 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.377082 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.377302 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.377394 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.377621 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.377733 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.377938 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.378047 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.378290 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.378405 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.378594 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.378696 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.378911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.379011 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.379229 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.379324 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.379547 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.379646 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.379861 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.379959 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.380173 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.380276 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.380488 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.380588 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.380810 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.380902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.381128 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.381231 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.381446 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.381539 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.381764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.381856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.382225 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.382376 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.382474 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.382559 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.382735 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.382836 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.383049 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.383229 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.383362 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.383455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.383676 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.383769 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.383993 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.384093 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.384326 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.384433 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.384643 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.384747 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.384951 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.385046 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.385288 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.385389 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.385612 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.385714 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.385933 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.386035 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.386332 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.386488 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.386649 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.386811 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.386978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.387149 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.387308 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.387481 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.387630 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.387812 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.387956 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.388145 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.388288 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.388468 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.388594 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.388816 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.389543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.389694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.389810 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.389954 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.390203 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.390321 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.390553 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.390658 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.390867 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.390967 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.391180 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.391285 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.391496 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.391596 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.391804 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.391902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.392122 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.392214 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.392435 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.392528 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.392747 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.392977 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.393080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.393377 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.393479 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.393657 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.393749 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.393966 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.394170 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.394311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.394401 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.394601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.394707 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.394911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.395006 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.395221 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.395312 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.395529 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.395620 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.395838 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.395940 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.396145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.396237 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.396454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.396558 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.396767 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.396858 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.397075 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.397168 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.397385 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.397492 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.397693 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.397786 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.398002 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.398161 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.398333 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.398447 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.398645 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.398744 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.398976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.399068 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.399289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.399391 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.399602 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.399694 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.399913 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.400005 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.400232 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.400326 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.400545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.400645 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.400854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.400947 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.401166 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.401276 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.401476 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.401568 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.401792 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.401884 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.402099 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.402198 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.402450 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.402543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.402763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.402863 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.403078 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.403177 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.403384 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.403482 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.403697 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.403802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.404013 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.404112 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.404347 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.404466 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.405186 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.405376 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.405500 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.405699 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.406016 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.406171 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.406363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.406637 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.406731 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.406825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.407004 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.407105 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.407322 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.407427 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.407658 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.407758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.407979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.408087 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.408297 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.408528 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.408630 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.408874 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.408976 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.409200 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.409310 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.409539 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.409640 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.409859 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.409965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.410171 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.410294 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.410510 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.410614 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.410821 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.410922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.411151 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.411246 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.411469 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.411570 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.411787 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.411880 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.412105 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.412199 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.412420 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.412515 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.412737 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.412840 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.413052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.413146 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.413369 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.413462 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.413683 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.413789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.413929 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 20:22:44.414029 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.414320 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.414637 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.414951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.415267 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.415589 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.415939 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.416264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.416589 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.416914 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.417235 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.417551 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.417866 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.418187 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.418527 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.418851 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.419187 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.419503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.419812 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.420342 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.421342 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.421672 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.422001 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.422342 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.422675 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.423007 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.423328 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.423658 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.423976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.424311 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.424654 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.424988 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.425318 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.425628 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.425938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.426257 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.426610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.426916 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.427230 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.427539 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.427847 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.428167 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.428480 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.428790 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.429096 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.429404 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.429717 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.430022 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.430352 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.430660 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.430967 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.431277 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.431594 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.431898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.432207 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.432516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.432825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.433133 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.433441 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.433781 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.434123 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.434472 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.434805 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.435125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.435452 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.435795 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.436123 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.436452 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.436779 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.437097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.437435 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.437750 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.438068 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.438418 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.438738 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.439058 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.439374 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.439710 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.440040 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.440351 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.440682 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.441007 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.441335 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.441660 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.441977 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.442350 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.442671 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.442989 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.443311 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.443628 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.443948 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.444272 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.444595 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.444930 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.445263 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.445583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.445914 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.446274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.446626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.446948 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.447303 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.447638 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.447958 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.448284 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.448598 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:22:44.448844 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 20:22:44.475363 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO dbcounter [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] Registered counter for database nova_api May 26 20:22:44.495816 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_db.sqlalchemy.engines [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:22:44.503565 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writer thread running {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:22:44.510636 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO dbcounter [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] Registered counter for database nova_api May 26 20:22:44.531448 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_db.sqlalchemy.engines [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:22:44.538784 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writer thread running {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:22:44.561035 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.context [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb70ed8b-e1e8-410e-9682-c3cef34f17da(cell1) {{(pid=118306) load_cells /opt/stack/nova/nova/context.py:464}} May 26 20:22:44.565245 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:22:44.566862 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:22:44.567676 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:22:44.569662 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:22:44.571673 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO dbcounter [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] Registered counter for database nova_cell0 May 26 20:22:44.575727 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO dbcounter [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] Registered counter for database nova_cell1 May 26 20:22:44.583107 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_db.sqlalchemy.engines [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:22:44.585423 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_db.sqlalchemy.engines [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:22:44.590945 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writer thread running {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:22:44.593685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writer thread running {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:22:44.596949 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.context [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb70ed8b-e1e8-410e-9682-c3cef34f17da(cell1) {{(pid=118307) load_cells /opt/stack/nova/nova/context.py:464}} May 26 20:22:44.601146 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:22:44.602765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:22:44.603580 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:22:44.605582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:22:44.607683 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO dbcounter [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] Registered counter for database nova_cell0 May 26 20:22:44.612290 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO dbcounter [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] Registered counter for database nova_cell1 May 26 20:22:44.619605 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_db.sqlalchemy.engines [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:22:44.621917 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_db.sqlalchemy.engines [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:22:44.628803 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writer thread running {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:22:44.629163 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writer thread running {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:22:44.744492 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO dbcounter [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] Registered counter for database nova_cell0 May 26 20:22:44.751311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_db.sqlalchemy.engines [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:22:44.755673 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writer thread running {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:22:44.779158 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO dbcounter [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] Registered counter for database nova_cell0 May 26 20:22:44.788767 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_db.sqlalchemy.engines [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:22:44.793223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writer thread running {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:22:45.080238 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: WARNING keystonemiddleware.auth_token [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 20:22:45.088772 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: WARNING keystonemiddleware.auth_token [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 20:22:45.125828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: WARNING keystonemiddleware.auth_token [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 20:22:45.134032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: WARNING keystonemiddleware.auth_token [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 20:22:45.436788 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: WARNING keystonemiddleware.auth_token [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 20:22:45.442842 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: WARNING keystonemiddleware.auth_token [None req-5f19e77d-64d8-4df3-b939-62688f5730a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 20:22:45.448365 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55654ac9f9c0 pid: 118306 (default app) May 26 20:22:45.483696 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: WARNING keystonemiddleware.auth_token [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 20:22:45.489651 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: WARNING keystonemiddleware.auth_token [None req-f53ccbb6-3608-4040-b6c8-46ba979b5dea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 20:22:45.494988 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55654ac9f9c0 pid: 118307 (default app) May 26 20:23:28.066011 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=3 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:28.067178 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=3 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:28.068917 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=3 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:28.075220 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=3 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:28.648748 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:28.649581 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:28.650697 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:28.662648 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:29.755305 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0ecb0026-d434-4eb8-b6ad-c19fbda36291 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Action: 'create', calling method: .version_select at 0x7f2da65bec10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1177647628"}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:30.287791 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-911fdf0b-ebee-4687-9e58-d009d443f27b tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] Action: 'create', calling method: .version_select at 0x7f2da65baca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1901123895", "metadata": {"Type": "work"}}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:32.347263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0ecb0026-d434-4eb8-b6ad-c19fbda36291 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.288036 May 26 20:23:32.354736 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1154 bytes} [Thu May 26 20:23:28 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4298 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 26 20:23:32.421346 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1255395441", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "networks": [{"uuid": "2df07b58-d56e-4c82-beee-beed1d505385"}]}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:32.608376 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.network.neutron [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] validate_networks() for [('2df07b58-d56e-4c82-beee-beed1d505385', None, None, None, None, None)] {{(pid=118306) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:23:32.969209 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-911fdf0b-ebee-4687-9e58-d009d443f27b tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.325130 May 26 20:23:32.972712 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 1/2] 10.222.0.44 () {60 vars in 1155 bytes} [Thu May 26 20:23:28 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4331 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 20:23:32.978659 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-907c05f1-fdf2-4d9b-b35b-5efe1d7adfad tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da640ac10>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:33.320189 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-907c05f1-fdf2-4d9b-b35b-5efe1d7adfad tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4" status: 200 len: 346 microversion: 2.1 time: 0.345843 May 26 20:23:33.321412 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:23:32 2022] GET /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4 => generated 346 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:33.327739 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7c43fb72-70da-4dd8-84e4-e4800f0b354d tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] Calling method '.version_select at 0x7f2da640adc0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:33.583727 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7c43fb72-70da-4dd8-84e4-e4800f0b354d tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea" status: 200 len: 353 microversion: 2.1 time: 0.261118 May 26 20:23:33.584775 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 3/4] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:23:33 2022] GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea => generated 353 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:33.592804 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-70f3e24c-9e15-4b9a-ae82-e5034983c659 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Action: 'create', calling method: .version_select at 0x7f2da64203a0>, body: {"snapshot": {"volume_id": "2a5cfb05-692e-4f66-a61e-07845e7636a4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-787701440"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:33.983957 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Flavor limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:23:33.984427 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Image limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:23:33.984843 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Flavor pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:23:33.985410 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Image pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:23:33.985973 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:23:34.025598 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:34.028828 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:34.036459 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:34.037068 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:34.153060 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Getting quotas for project bc985cd350244df2b68443a15e584db5. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:23:34.185948 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Getting quotas for user e07dc94f1b6243d087f6d2d432a15b99 and project bc985cd350244df2b68443a15e584db5. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:23:34.222421 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Going to run 1 instances... {{(pid=118306) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:23:34.227017 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:23:34.277600 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-70f3e24c-9e15-4b9a-ae82-e5034983c659 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.690544 May 26 20:23:34.280731 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 4/5] 10.222.0.44 () {60 vars in 1161 bytes} [Thu May 26 20:23:33 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:34.290167 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6fa62863-2164-4e65-baf5-80f228a407e5 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da6429040>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:34.415211 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6fa62863-2164-4e65-baf5-80f228a407e5 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d" status: 200 len: 286 microversion: 2.1 time: 0.129181 May 26 20:23:34.416146 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 5/6] 10.222.0.44 () {58 vars in 1250 bytes} [Thu May 26 20:23:34 2022] GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d => generated 286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:23:34.426038 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ef6064fe-cb5b-4b27-a86d-f89f76dcfcea tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da6420c10>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:34.528014 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ef6064fe-cb5b-4b27-a86d-f89f76dcfcea tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.105811 May 26 20:23:34.531743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 6/7] 10.222.0.44 () {58 vars in 1139 bytes} [Thu May 26 20:23:34 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:34.542001 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9577d7ae-62dc-43e8-9299-e939df90b485 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da640aa60>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:34.599490 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0144a814-5951-4b49-aacd-79daed04136c tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.243410 May 26 20:23:34.600136 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 2/8] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:23:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:23:34.630863 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2e94a910-e053-46f5-b4d9-ffdd863bf759 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] Calling method '.version_select at 0x7f2da5b23700>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:34.665901 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9577d7ae-62dc-43e8-9299-e939df90b485 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d" status: 200 len: 286 microversion: 2.1 time: 0.128982 May 26 20:23:34.666493 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 7/9] 10.222.0.44 () {58 vars in 1250 bytes} [Thu May 26 20:23:34 2022] GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d => generated 286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:34.671988 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8563bee1-149d-41ff-bf70-4e5fedfacb7d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:34.672755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8563bee1-149d-41ff-bf70-4e5fedfacb7d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:34.776284 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2e94a910-e053-46f5-b4d9-ffdd863bf759 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea" status: 200 len: 354 microversion: 2.1 time: 0.169992 May 26 20:23:34.785931 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 3/10] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:23:34 2022] GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea => generated 354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:34.798742 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8dd703d9-ade0-4505-bd31-69f400713d94 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] Calling method '.version_select at 0x7f2da5b23e50>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:34.907683 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-8563bee1-149d-41ff-bf70-4e5fedfacb7d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:34.921045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8dd703d9-ade0-4505-bd31-69f400713d94 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea" status: 200 len: 354 microversion: 2.1 time: 0.109634 May 26 20:23:34.922331 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 4/11] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:23:34 2022] GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea => generated 354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:34.933206 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9c264f8d-b6db-4972-882f-774f1a8dad07 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] Calling method '.version_select at 0x7f2da5b23c10>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:34.947016 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8563bee1-149d-41ff-bf70-4e5fedfacb7d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1215 microversion: 2.1 time: 0.272436 May 26 20:23:34.947679 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 8/12] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:34 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1215 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:35.307928 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9c264f8d-b6db-4972-882f-774f1a8dad07 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea" status: 202 len: 0 microversion: 2.1 time: 0.378161 May 26 20:23:35.313515 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 5/13] 10.222.0.44 () {58 vars in 1247 bytes} [Thu May 26 20:23:34 2022] DELETE /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:23:35.320304 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b4872d9a-f950-4ef0-a4ac-a06ec1e56eeb tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] Calling method '.version_select at 0x7f2da64294c0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:35.473084 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b4872d9a-f950-4ef0-a4ac-a06ec1e56eeb tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea" status: 200 len: 353 microversion: 2.1 time: 0.158567 May 26 20:23:35.474111 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 9/14] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:23:35 2022] GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea => generated 353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:35.686127 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2d161a2e-b35e-432f-b37d-a4203eae8b50 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da63e68b0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:35.810618 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2d161a2e-b35e-432f-b37d-a4203eae8b50 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d" status: 200 len: 286 microversion: 2.1 time: 0.135507 May 26 20:23:35.811193 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 10/15] 10.222.0.44 () {58 vars in 1250 bytes} [Thu May 26 20:23:35 2022] GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:35.888622 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-faeb106b-7e6f-43c6-b245-fea4c778863a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Action: 'create', calling method: .version_select at 0x7f2da5b231f0>, body: {"keypair": {"name": "tempest-keypair-681453825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgdLkjau8HgRBpPSPLKPPfYOB667iGVtFOxAkA2rKIP5i9SVsUXPu5w4mYw5H58RDaXIMlVPg+rx3DjTi2dOz5f/NlZaNkOYpzg+Hf9jKM0WNzomkiFaXiJeMr6qvBxBg=="}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:35.965353 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a089d939-338f-40c0-a9b1-ba743fa19e9b tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:35.966070 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a089d939-338f-40c0-a9b1-ba743fa19e9b tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:35.976991 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-faeb106b-7e6f-43c6-b245-fea4c778863a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Getting quotas for project 414b3aedf5e947d39018df71b2f106ba. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:23:35.999459 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-faeb106b-7e6f-43c6-b245-fea4c778863a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Getting quotas for user d35a55bcc5754bf88adbd343ab8116d2 and project 414b3aedf5e947d39018df71b2f106ba. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:23:36.189686 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a089d939-338f-40c0-a9b1-ba743fa19e9b tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:36.195014 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-faeb106b-7e6f-43c6-b245-fea4c778863a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.596348 May 26 20:23:36.198048 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a089d939-338f-40c0-a9b1-ba743fa19e9b tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1215 microversion: 2.1 time: 0.236841 May 26 20:23:36.201655 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 6/16] 10.222.0.44 () {60 vars in 1158 bytes} [Thu May 26 20:23:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:36.224751 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 11/17] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:35 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:36.486387 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cf40dc4f-1599-4bf0-9511-b5e90e3b4b4d tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] Calling method '.version_select at 0x7f2da6399af0>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:36.589675 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-cf40dc4f-1599-4bf0-9511-b5e90e3b4b4d tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea" status: 200 len: 353 microversion: 2.1 time: 0.106948 May 26 20:23:36.595506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 7/18] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:23:36 2022] GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:36.830033 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f97641a7-426e-44b4-ac2e-a5f4523297d8 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da63e6700>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:36.883964 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f97641a7-426e-44b4-ac2e-a5f4523297d8 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d" status: 200 len: 286 microversion: 2.1 time: 0.059043 May 26 20:23:36.889222 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 12/19] 10.222.0.44 () {58 vars in 1250 bytes} [Thu May 26 20:23:36 2022] GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:37.215370 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6d19b8f1-3dc5-452c-86bd-195b92b8fa41 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:37.217062 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6d19b8f1-3dc5-452c-86bd-195b92b8fa41 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:37.446038 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6d19b8f1-3dc5-452c-86bd-195b92b8fa41 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:37.470714 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6d19b8f1-3dc5-452c-86bd-195b92b8fa41 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1215 microversion: 2.1 time: 0.259022 May 26 20:23:37.472928 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 8/20] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:37 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:37.603798 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a8d7b940-425a-45cf-9f43-6c8d756f6187 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] Calling method '.version_select at 0x7f2da64295e0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:37.666156 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a8d7b940-425a-45cf-9f43-6c8d756f6187 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea" status: 200 len: 353 microversion: 2.1 time: 0.067136 May 26 20:23:37.676813 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 13/21] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:23:37 2022] GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:37.922428 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1baea369-ac53-4316-ab55-3e467de71914 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da52dbe50>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:37.999671 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1baea369-ac53-4316-ab55-3e467de71914 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d" status: 200 len: 287 microversion: 2.1 time: 0.105711 May 26 20:23:38.000872 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 9/22] 10.222.0.44 () {58 vars in 1250 bytes} [Thu May 26 20:23:37 2022] GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:38.019784 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4c9eb63c-05c3-4094-b0a7-be895c211136 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da63ee5e0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:38.232340 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4c9eb63c-05c3-4094-b0a7-be895c211136 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d" status: 202 len: 0 microversion: 2.1 time: 0.216357 May 26 20:23:38.232905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 14/23] 10.222.0.44 () {58 vars in 1253 bytes} [Thu May 26 20:23:38 2022] DELETE /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:23:38.241958 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b3ab6efd-50b6-49c3-9cb1-46620778b323 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da4a854c0>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:38.303752 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b3ab6efd-50b6-49c3-9cb1-46620778b323 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d" status: 200 len: 286 microversion: 2.1 time: 0.066097 May 26 20:23:38.341283 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 10/24] 10.222.0.44 () {58 vars in 1250 bytes} [Thu May 26 20:23:38 2022] GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:38.495965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b3189168-2adc-4a25-8304-30d61500acc8 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:38.496783 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b3189168-2adc-4a25-8304-30d61500acc8 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:38.510621 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3189168-2adc-4a25-8304-30d61500acc8 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:38.516289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3189168-2adc-4a25-8304-30d61500acc8 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:38.517520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3189168-2adc-4a25-8304-30d61500acc8 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:38.518049 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3189168-2adc-4a25-8304-30d61500acc8 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:38.681128 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-04bc4872-0575-4e49-9dba-91ce792be9c4 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] Calling method '.version_select at 0x7f2da52dbee0>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:38.760966 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-04bc4872-0575-4e49-9dba-91ce792be9c4 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] HTTP exception thrown: Volume 1b86a32d-0d63-422b-a1fa-97b2b4578dea could not be found. May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-04bc4872-0575-4e49-9dba-91ce792be9c4 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] Request method failure captured: May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea HTTP/1.1 May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-HADHBzf2yItpTF_aMyCo4WNZSxaXfcsIczNaY_OeMrfazkHGGk0OOJMfMTgai5S_FVNBw9bOl1mhpDPpKfrTGxC8bLcJ724OUmqPftjGyKWTOfiQ4mtfInHBh4U0TuMpBVW0INx0PZ7bYgyOkj4w9MSXhKOVmHmWq0VGBQp1cFkW0 May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: c545cc0f3c4c4de3a63f319f70a9b3f7 May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-VolumesGetTestJSON-702781689 May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:23:38.766030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c545cc0f3c4c4de3a63f319f70a9b3f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c545cc0f3c4c4de3a63f319f70a9b3f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c545cc0f3c4c4de3a63f319f70a9b3f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c545cc0f3c4c4de3a63f319f70a9b3f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-VolumesGetTestJSON-702781689 May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: c545cc0f3c4c4de3a63f319f70a9b3f7 May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-VolumesGetTestJSON-702781689 May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-VolumesGetTestJSON-702781689-project May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: 983865094823401e8cd342e60879128f May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-VolumesGetTestJSON-702781689-project May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Volume 1b86a32d-0d63-422b-a1fa-97b2b4578dea could not be found. May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '1b86a32d-0d63-422b-a1fa-97b2b4578dea'} May 26 20:23:38.767405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b86a32d-0d63-422b-a1fa-97b2b4578dea could not be found. (HTTP 404) (Request-ID: req-b5f5c5f0-0fa1-485b-a3fe-73ad3bac211e) May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:38.768069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 20:23:38.769071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b86a32d-0d63-422b-a1fa-97b2b4578dea could not be found. May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 20:23:38.769950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b86a32d-0d63-422b-a1fa-97b2b4578dea could not be found. May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b86a32d-0d63-422b-a1fa-97b2b4578dea could not be found. May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-04bc4872-0575-4e49-9dba-91ce792be9c4 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] Returning 404 to user: Volume 1b86a32d-0d63-422b-a1fa-97b2b4578dea could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:23:38.773066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-04bc4872-0575-4e49-9dba-91ce792be9c4 tempest-VolumesGetTestJSON-702781689 tempest-VolumesGetTestJSON-702781689-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea" status: 404 len: 109 microversion: 2.1 time: 0.095472 May 26 20:23:38.778884 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 11/25] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:23:38 2022] GET /compute/v2.1/os-volumes/1b86a32d-0d63-422b-a1fa-97b2b4578dea => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 20:23:38.871432 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b3189168-2adc-4a25-8304-30d61500acc8 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:38.915798 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b3189168-2adc-4a25-8304-30d61500acc8 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1211 microversion: 2.1 time: 0.429431 May 26 20:23:38.918346 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 15/26] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:38 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1211 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:39.359183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6d81989a-4a34-47e5-bfaa-419a4354fc8e tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da6d8e1f0>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:39.401675 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-6d81989a-4a34-47e5-bfaa-419a4354fc8e tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] HTTP exception thrown: Snapshot 6893e3b9-c673-4daf-86b2-ef3fa34dc37d could not be found. May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6d81989a-4a34-47e5-bfaa-419a4354fc8e tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Request method failure captured: May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d HTTP/1.1 May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-G_szM9hPmr4ISgue0VypnM4ErxAF5et-U7fegvjaphaD98BS0gHdj0QcGjoqvhmE6qa_z8sizMNvNHLkQuRUyrqo49ic-Bh07QMTmqngskeHq_TXgpakUoxTnaymwCwjHqHWCUgHDe8SbmaA3IzECCRjwy2GZ4MPaZZRbrXu9qcEA May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: c163e059841b415886fc7534907efd10 May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1671556465 May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:23:39.406894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c163e059841b415886fc7534907efd10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c163e059841b415886fc7534907efd10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c163e059841b415886fc7534907efd10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c163e059841b415886fc7534907efd10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1671556465 May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: c163e059841b415886fc7534907efd10 May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1671556465 May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-VolumesSnapshotsTestJSON-1671556465-project May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: d91263e9b9284c7d8b895c1c1d923e0a May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1671556465-project May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Snapshot 6893e3b9-c673-4daf-86b2-ef3fa34dc37d could not be found. May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '6893e3b9-c673-4daf-86b2-ef3fa34dc37d'} May 26 20:23:39.407988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6893e3b9-c673-4daf-86b2-ef3fa34dc37d could not be found. (HTTP 404) (Request-ID: req-52a90bbc-b83d-4717-8b88-b0d36ebd11d4) May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:39.408631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 20:23:39.409446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6893e3b9-c673-4daf-86b2-ef3fa34dc37d could not be found. May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 20:23:39.410350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6893e3b9-c673-4daf-86b2-ef3fa34dc37d could not be found. May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6893e3b9-c673-4daf-86b2-ef3fa34dc37d could not be found. May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6d81989a-4a34-47e5-bfaa-419a4354fc8e tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Returning 404 to user: Snapshot 6893e3b9-c673-4daf-86b2-ef3fa34dc37d could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:23:39.413142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6d81989a-4a34-47e5-bfaa-419a4354fc8e tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d" status: 404 len: 111 microversion: 2.1 time: 0.055927 May 26 20:23:39.415788 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 12/27] 10.222.0.44 () {58 vars in 1250 bytes} [Thu May 26 20:23:39 2022] GET /compute/v2.1/os-snapshots/6893e3b9-c673-4daf-86b2-ef3fa34dc37d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:23:39.424834 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b05ccd8a-3f40-4614-9f26-51d4c92dbd14 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da63765e0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:39.712718 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b05ccd8a-3f40-4614-9f26-51d4c92dbd14 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4" status: 202 len: 0 microversion: 2.1 time: 0.294865 May 26 20:23:39.717871 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 16/28] 10.222.0.44 () {58 vars in 1247 bytes} [Thu May 26 20:23:39 2022] DELETE /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:23:39.723951 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-74b3bd63-5eb8-4d0d-a59e-35d974eacd2e tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da4a59a60>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:39.948100 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-74b3bd63-5eb8-4d0d-a59e-35d974eacd2e tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4" status: 200 len: 345 microversion: 2.1 time: 0.228652 May 26 20:23:39.951325 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 13/29] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:23:39 2022] GET /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4 => generated 345 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:39.952112 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4c3321d8-a9e3-4d60-bcec-9c96a4a366f1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:39.954422 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4c3321d8-a9e3-4d60-bcec-9c96a4a366f1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:39.967303 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4c3321d8-a9e3-4d60-bcec-9c96a4a366f1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:39.967988 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4c3321d8-a9e3-4d60-bcec-9c96a4a366f1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:39.970722 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4c3321d8-a9e3-4d60-bcec-9c96a4a366f1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:39.972338 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4c3321d8-a9e3-4d60-bcec-9c96a4a366f1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:40.213954 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-4c3321d8-a9e3-4d60-bcec-9c96a4a366f1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:40.227983 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4c3321d8-a9e3-4d60-bcec-9c96a4a366f1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1275 microversion: 2.1 time: 0.291757 May 26 20:23:40.241114 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 17/30] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:39 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1275 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:23:40.965592 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4f3c45f6-347b-42ab-84eb-48e7a4906a82 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da4a721f0>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:41.015908 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-4f3c45f6-347b-42ab-84eb-48e7a4906a82 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] HTTP exception thrown: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4f3c45f6-347b-42ab-84eb-48e7a4906a82 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Request method failure captured: May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4 HTTP/1.1 May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-G_szM9hPmr4ISgue0VypnM4ErxAF5et-U7fegvjaphaD98BS0gHdj0QcGjoqvhmE6qa_z8sizMNvNHLkQuRUyrqo49ic-Bh07QMTmqngskeHq_TXgpakUoxTnaymwCwjHqHWCUgHDe8SbmaA3IzECCRjwy2GZ4MPaZZRbrXu9qcEA May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: c163e059841b415886fc7534907efd10 May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1671556465 May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:23:41.018213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c163e059841b415886fc7534907efd10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c163e059841b415886fc7534907efd10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c163e059841b415886fc7534907efd10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c163e059841b415886fc7534907efd10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1671556465 May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: c163e059841b415886fc7534907efd10 May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1671556465 May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-VolumesSnapshotsTestJSON-1671556465-project May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: d91263e9b9284c7d8b895c1c1d923e0a May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1671556465-project May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '2a5cfb05-692e-4f66-a61e-07845e7636a4'} May 26 20:23:41.026020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. (HTTP 404) (Request-ID: req-062b0577-4fd5-4588-8445-27a19dea983d) May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:41.026962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 20:23:41.027822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 20:23:41.029416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4f3c45f6-347b-42ab-84eb-48e7a4906a82 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Returning 404 to user: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4f3c45f6-347b-42ab-84eb-48e7a4906a82 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4" status: 404 len: 109 microversion: 2.1 time: 0.058185 May 26 20:23:41.030601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 14/31] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:23:40 2022] GET /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:23:41.037608 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6af52d09-9044-4b06-9c3c-576944eee258 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da632d790>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:41.091094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-6af52d09-9044-4b06-9c3c-576944eee258 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] HTTP exception thrown: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6af52d09-9044-4b06-9c3c-576944eee258 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Request method failure captured: May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: DELETE /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4 HTTP/1.1 May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-G_szM9hPmr4ISgue0VypnM4ErxAF5et-U7fegvjaphaD98BS0gHdj0QcGjoqvhmE6qa_z8sizMNvNHLkQuRUyrqo49ic-Bh07QMTmqngskeHq_TXgpakUoxTnaymwCwjHqHWCUgHDe8SbmaA3IzECCRjwy2GZ4MPaZZRbrXu9qcEA May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: c163e059841b415886fc7534907efd10 May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1671556465 May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:23:41.095828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c163e059841b415886fc7534907efd10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c163e059841b415886fc7534907efd10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c163e059841b415886fc7534907efd10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c163e059841b415886fc7534907efd10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1671556465 May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: c163e059841b415886fc7534907efd10 May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1671556465 May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-VolumesSnapshotsTestJSON-1671556465-project May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: d91263e9b9284c7d8b895c1c1d923e0a May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1671556465-project May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '2a5cfb05-692e-4f66-a61e-07845e7636a4'} May 26 20:23:41.096902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. (HTTP 404) (Request-ID: req-4ed6abc0-6d8e-4192-9244-475fcff3e537) May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:41.097573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 20:23:41.099973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 20:23:41.102640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6af52d09-9044-4b06-9c3c-576944eee258 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Returning 404 to user: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6af52d09-9044-4b06-9c3c-576944eee258 tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4" status: 404 len: 109 microversion: 2.1 time: 0.063918 May 26 20:23:41.106017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 18/32] 10.222.0.44 () {58 vars in 1247 bytes} [Thu May 26 20:23:41 2022] DELETE /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:23:41.108402 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e33487fd-bc6b-4f11-b98f-7a3577e6d32c tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Calling method '.version_select at 0x7f2da4a591f0>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:41.162691 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-e33487fd-bc6b-4f11-b98f-7a3577e6d32c tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] HTTP exception thrown: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e33487fd-bc6b-4f11-b98f-7a3577e6d32c tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Request method failure captured: May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4 HTTP/1.1 May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-G_szM9hPmr4ISgue0VypnM4ErxAF5et-U7fegvjaphaD98BS0gHdj0QcGjoqvhmE6qa_z8sizMNvNHLkQuRUyrqo49ic-Bh07QMTmqngskeHq_TXgpakUoxTnaymwCwjHqHWCUgHDe8SbmaA3IzECCRjwy2GZ4MPaZZRbrXu9qcEA May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: c163e059841b415886fc7534907efd10 May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1671556465 May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:23:41.172298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c163e059841b415886fc7534907efd10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c163e059841b415886fc7534907efd10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c163e059841b415886fc7534907efd10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c163e059841b415886fc7534907efd10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1671556465 May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: c163e059841b415886fc7534907efd10 May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1671556465 May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-VolumesSnapshotsTestJSON-1671556465-project May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: d91263e9b9284c7d8b895c1c1d923e0a May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1671556465-project May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '2a5cfb05-692e-4f66-a61e-07845e7636a4'} May 26 20:23:41.173582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. (HTTP 404) (Request-ID: req-633834b2-1434-4fb3-ac2c-5c40e357c2aa) May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:41.174425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 20:23:41.175506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 20:23:41.176596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:23:41.177654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.177654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.177654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:41.177654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.177654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:41.177654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:41.177654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:41.177654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:23:41.177654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:23:41.177654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. May 26 20:23:41.177654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:41.178323 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e33487fd-bc6b-4f11-b98f-7a3577e6d32c tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] Returning 404 to user: Volume 2a5cfb05-692e-4f66-a61e-07845e7636a4 could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:23:41.179301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e33487fd-bc6b-4f11-b98f-7a3577e6d32c tempest-VolumesSnapshotsTestJSON-1671556465 tempest-VolumesSnapshotsTestJSON-1671556465-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4" status: 404 len: 109 microversion: 2.1 time: 0.076340 May 26 20:23:41.182489 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 15/33] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:23:41 2022] GET /compute/v2.1/os-volumes/2a5cfb05-692e-4f66-a61e-07845e7636a4 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 20:23:41.246366 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a7214a0b-a02e-4992-8500-192dd654c8ce tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:41.247236 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a7214a0b-a02e-4992-8500-192dd654c8ce tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:41.257449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a7214a0b-a02e-4992-8500-192dd654c8ce tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:41.267068 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a7214a0b-a02e-4992-8500-192dd654c8ce tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:41.267927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a7214a0b-a02e-4992-8500-192dd654c8ce tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:41.269068 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a7214a0b-a02e-4992-8500-192dd654c8ce tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:41.579773 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1053766392", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:41.682819 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] validate_networks() for [('a9361726-4003-4ced-913d-aaf303561595', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:23:41.795296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a7214a0b-a02e-4992-8500-192dd654c8ce tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:41.822084 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a7214a0b-a02e-4992-8500-192dd654c8ce tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1273 microversion: 2.1 time: 0.580760 May 26 20:23:41.840328 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 16/34] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:41 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1273 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:42.860869 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-791a05e1-350e-455f-aeaf-c02b3b025d38 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:42.861840 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-791a05e1-350e-455f-aeaf-c02b3b025d38 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:42.875318 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-791a05e1-350e-455f-aeaf-c02b3b025d38 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:42.876688 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-791a05e1-350e-455f-aeaf-c02b3b025d38 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:42.878643 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-791a05e1-350e-455f-aeaf-c02b3b025d38 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:42.880096 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-791a05e1-350e-455f-aeaf-c02b3b025d38 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:43.270924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-791a05e1-350e-455f-aeaf-c02b3b025d38 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:43.290193 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-791a05e1-350e-455f-aeaf-c02b3b025d38 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.436811 May 26 20:23:43.290867 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 17/35] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:42 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:43.298631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-73590765", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "781b6e2a-0fd2-490f-8060-5db4b6f9e2c7"}], "security_groups": [{"name": "tempest-securitygroup--1160851284"}], "key_name": "tempest-keypair-681453825", "user_data": "}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:43.581790 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.network.neutron [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] validate_networks() for [('781b6e2a-0fd2-490f-8060-5db4b6f9e2c7', None, None, None, None, None)] {{(pid=118306) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:23:44.096366 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Flavor limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:23:44.098315 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Image limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:23:44.099275 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Flavor pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:23:44.100047 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Image pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:23:44.100677 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:23:44.119473 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:44.133336 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:44.135917 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:44.137109 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:44.140182 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:44.186548 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Getting quotas for project 414b3aedf5e947d39018df71b2f106ba. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:23:44.197565 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Getting quotas for user d35a55bcc5754bf88adbd343ab8116d2 and project 414b3aedf5e947d39018df71b2f106ba. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:23:44.224992 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Going to run 1 instances... {{(pid=118306) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:23:44.229184 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:23:44.396112 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b5e3f134-88cf-4c47-810d-83467ea1ea6c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.102948 May 26 20:23:44.402038 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 18/36] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:23:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:23:44.410807 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0787efe6-0667-4060-b477-6468dd37d89f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:44.414146 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0787efe6-0667-4060-b477-6468dd37d89f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:44.433887 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0787efe6-0667-4060-b477-6468dd37d89f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:44.436453 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0787efe6-0667-4060-b477-6468dd37d89f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:44.440437 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0787efe6-0667-4060-b477-6468dd37d89f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:44.441266 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0787efe6-0667-4060-b477-6468dd37d89f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:45.069189 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-0787efe6-0667-4060-b477-6468dd37d89f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:45.089157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0787efe6-0667-4060-b477-6468dd37d89f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.691145 May 26 20:23:45.097330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 19/37] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:44 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:45.109010 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4d3fcc3b-e558-4768-a2d1-391a783fc4c6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:45.111091 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4d3fcc3b-e558-4768-a2d1-391a783fc4c6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:45.118547 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:23:45.119082 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:23:45.119446 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:23:45.120223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:23:45.122114 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:23:45.190279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:45.202998 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:45.207191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:45.207815 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:45.323078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Getting quotas for project f6160118ba95403e8df08ac74982954d. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:23:45.336249 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Getting quotas for user 146a7d1f40854f859864d463f403178f and project f6160118ba95403e8df08ac74982954d. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:23:45.362925 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4d3fcc3b-e558-4768-a2d1-391a783fc4c6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:45.364900 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:23:45.370635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:23:45.373364 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4d3fcc3b-e558-4768-a2d1-391a783fc4c6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1235 microversion: 2.1 time: 0.273965 May 26 20:23:45.376535 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 20/38] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:45 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1235 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:45.637762 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cb7d2afb-5e17-42f4-bb13-0679f0509e4a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.442192 May 26 20:23:45.637762 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:23:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 4444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:23:45.643266 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e08a1b67-a292-4d4e-9707-d051147f3099 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:45.643895 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e08a1b67-a292-4d4e-9707-d051147f3099 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:45.795322 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e08a1b67-a292-4d4e-9707-d051147f3099 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:45.810255 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e08a1b67-a292-4d4e-9707-d051147f3099 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1222 microversion: 2.1 time: 0.170421 May 26 20:23:45.811756 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 21/40] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:45 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1222 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:46.108810 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5de25813-4cf4-473f-a3f0-b5d69be30cdc tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:46.109725 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5de25813-4cf4-473f-a3f0-b5d69be30cdc tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:46.119505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5de25813-4cf4-473f-a3f0-b5d69be30cdc tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:46.120630 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5de25813-4cf4-473f-a3f0-b5d69be30cdc tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:46.122182 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5de25813-4cf4-473f-a3f0-b5d69be30cdc tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:46.127590 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5de25813-4cf4-473f-a3f0-b5d69be30cdc tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:46.404592 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c25ca263-db9b-4d4c-8488-e67bfa282b49 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:46.405313 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5de25813-4cf4-473f-a3f0-b5d69be30cdc tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:46.405463 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c25ca263-db9b-4d4c-8488-e67bfa282b49 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:46.428922 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5de25813-4cf4-473f-a3f0-b5d69be30cdc tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.324719 May 26 20:23:46.431197 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 20/41] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:46 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:46.565449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c25ca263-db9b-4d4c-8488-e67bfa282b49 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:46.576163 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c25ca263-db9b-4d4c-8488-e67bfa282b49 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1235 microversion: 2.1 time: 0.175490 May 26 20:23:46.579393 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 22/42] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:46 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1235 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:46.704508 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1078855710", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:46.798340 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] validate_networks() for [('a9361726-4003-4ced-913d-aaf303561595', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:23:47.449806 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-bb1ccfeb-1068-48b3-b8c7-94cb771ab54e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:47.454378 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-bb1ccfeb-1068-48b3-b8c7-94cb771ab54e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:47.470215 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bb1ccfeb-1068-48b3-b8c7-94cb771ab54e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:47.473689 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bb1ccfeb-1068-48b3-b8c7-94cb771ab54e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:47.475395 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bb1ccfeb-1068-48b3-b8c7-94cb771ab54e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:47.476077 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bb1ccfeb-1068-48b3-b8c7-94cb771ab54e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:47.823788 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-bb1ccfeb-1068-48b3-b8c7-94cb771ab54e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:47.837333 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-bb1ccfeb-1068-48b3-b8c7-94cb771ab54e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.392402 May 26 20:23:47.840700 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 23/43] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:47 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:47.853875 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2ee1ab7a-65e0-4b2f-a8d2-bb25abeee5cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:47.859814 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2ee1ab7a-65e0-4b2f-a8d2-bb25abeee5cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:47.888510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2ee1ab7a-65e0-4b2f-a8d2-bb25abeee5cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:47.889860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2ee1ab7a-65e0-4b2f-a8d2-bb25abeee5cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:47.894806 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2ee1ab7a-65e0-4b2f-a8d2-bb25abeee5cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:47.895491 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2ee1ab7a-65e0-4b2f-a8d2-bb25abeee5cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:48.153791 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2ee1ab7a-65e0-4b2f-a8d2-bb25abeee5cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:48.188113 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2ee1ab7a-65e0-4b2f-a8d2-bb25abeee5cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1231 microversion: 2.1 time: 0.329860 May 26 20:23:48.188113 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 24/44] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:47 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1231 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:48.250046 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:23:48.250665 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:23:48.251241 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:23:48.251739 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:23:48.252440 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:23:48.273017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:48.273610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:48.274721 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:48.275260 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:48.295714 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Getting quotas for project f6160118ba95403e8df08ac74982954d. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:23:48.300434 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Getting quotas for user 146a7d1f40854f859864d463f403178f and project f6160118ba95403e8df08ac74982954d. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:23:48.314448 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:23:48.327410 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:23:48.512912 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-679fea32-0db4-4c38-bac9-35ec4f467387 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.816736 May 26 20:23:48.523542 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 21/45] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:23:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:23:48.537545 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c4aca9c8-de1d-4b30-9dd4-e789b0ac30f6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:48.537545 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c4aca9c8-de1d-4b30-9dd4-e789b0ac30f6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:48.676145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c4aca9c8-de1d-4b30-9dd4-e789b0ac30f6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:48.693512 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c4aca9c8-de1d-4b30-9dd4-e789b0ac30f6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1222 microversion: 2.1 time: 0.161892 May 26 20:23:48.694789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 25/46] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:48 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:23:48.857589 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5e9b402c-9512-4512-92a9-08cbc413677d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:48.858290 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5e9b402c-9512-4512-92a9-08cbc413677d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:48.864802 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5e9b402c-9512-4512-92a9-08cbc413677d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:48.865506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5e9b402c-9512-4512-92a9-08cbc413677d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:48.866527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5e9b402c-9512-4512-92a9-08cbc413677d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:48.867157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5e9b402c-9512-4512-92a9-08cbc413677d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:49.171525 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5e9b402c-9512-4512-92a9-08cbc413677d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:49.192809 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5e9b402c-9512-4512-92a9-08cbc413677d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.338384 May 26 20:23:49.203287 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 26/47] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:48 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:49.490448 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-ee8fee9f-2113-439d-8159-21cc91f94cc1 req-816f4d55-279d-4701-97a9-ae09dd565917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee319d6b-f1f1-4aa0-87f9-a7968127f8fb", "tag": "6b5b82bb-9720-45e8-b150-c8e10e1ded24"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:49.530211 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-ee8fee9f-2113-439d-8159-21cc91f94cc1 req-816f4d55-279d-4701-97a9-ae09dd565917 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:49.531963 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-ee8fee9f-2113-439d-8159-21cc91f94cc1 req-816f4d55-279d-4701-97a9-ae09dd565917 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:49.604373 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-ee8fee9f-2113-439d-8159-21cc91f94cc1 req-816f4d55-279d-4701-97a9-ae09dd565917 service nova] Creating event network-changed:6b5b82bb-9720-45e8-b150-c8e10e1ded24 for instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb on hv-cinder-84213 May 26 20:23:49.605047 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-ee8fee9f-2113-439d-8159-21cc91f94cc1 req-816f4d55-279d-4701-97a9-ae09dd565917 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118307) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 20:23:49.609285 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-68e26208-2b14-46e7-923e-98a545646624 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:49.610761 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-68e26208-2b14-46e7-923e-98a545646624 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:49.611920 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-68e26208-2b14-46e7-923e-98a545646624 None None] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:49.612702 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-68e26208-2b14-46e7-923e-98a545646624 None None] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:49.639461 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6b3975ef-3748-4e1a-b288-69170b0b0a88 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Action: 'create', calling method: .version_select at 0x7f2da4965160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1606513597", "metadata": {"Type": "work"}}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:49.649492 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.compute.rpcapi [None req-68e26208-2b14-46e7-923e-98a545646624 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 20:23:49.650580 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-68e26208-2b14-46e7-923e-98a545646624 None None] Releasing lock "compute-rpcapi-router" {{(pid=118307) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6b3975ef-3748-4e1a-b288-69170b0b0a88 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Request method failure captured: May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 122 May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-HUG3Fg-6QVGXOpL_MlEzwXuY3JtqB-x8LbmdbBGSCumpMKz-4dBbXSRza7dORQW40_i9AbHgGthhfHDzYCyZvgLbU_vLMJ75o0fYYYGu7A6YU_VUblFuyVx_Z7baMhhTvSdHSE93WQ_i_AsCOCaIZLi2nEpQ_y9_pslNeKv3ROHUs May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: 04da4360d2e74d178d1bae2c18da955e May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-VolumesNegativeTest-1567578667 May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:23:49.661195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-VolumesNegativeTest-1567578667 May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: 04da4360d2e74d178d1bae2c18da955e May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-VolumesNegativeTest-1567578667 May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-VolumesNegativeTest-1567578667-project May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: a0e45c8f9da34516940c9a6dc75e5758 May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-VolumesNegativeTest-1567578667-project May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1606513597", "metadata": {"Type": "work"}}} May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: May 26 20:23:49.663263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1606513597', 'metadata': {'Type': 'work'}}}} May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise error May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi '#$%' May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:23:49.664151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 20:23:49.665564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 20:23:49.669810 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 20:23:49.669810 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:49.669810 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6b3975ef-3748-4e1a-b288-69170b0b0a88 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:23:49.670440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6b3975ef-3748-4e1a-b288-69170b0b0a88 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.465338 May 26 20:23:49.671232 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 27/48] 10.222.0.44 () {60 vars in 1155 bytes} [Thu May 26 20:23:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 468 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 20:23:49.678619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-69783718-9412-4e47-a83b-f1ac6c871ae4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:49.680957 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-69783718-9412-4e47-a83b-f1ac6c871ae4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:49.700305 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-69783718-9412-4e47-a83b-f1ac6c871ae4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:49.701107 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-69783718-9412-4e47-a83b-f1ac6c871ae4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:49.703715 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-69783718-9412-4e47-a83b-f1ac6c871ae4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:49.706209 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-69783718-9412-4e47-a83b-f1ac6c871ae4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:49.733445 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-68e26208-2b14-46e7-923e-98a545646624 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.945854 May 26 20:23:49.734766 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 22/49] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:49.747320 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cf3a74f1-298b-4056-a02b-c58e895867f7 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Action: 'create', calling method: .version_select at 0x7f2da61ec670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1626016555", "metadata": {"Type": "work"}}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cf3a74f1-298b-4056-a02b-c58e895867f7 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Request method failure captured: May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 120 May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HUG3Fg-6QVGXOpL_MlEzwXuY3JtqB-x8LbmdbBGSCumpMKz-4dBbXSRza7dORQW40_i9AbHgGthhfHDzYCyZvgLbU_vLMJ75o0fYYYGu7A6YU_VUblFuyVx_Z7baMhhTvSdHSE93WQ_i_AsCOCaIZLi2nEpQ_y9_pslNeKv3ROHUs May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 04da4360d2e74d178d1bae2c18da955e May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesNegativeTest-1567578667 May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:23:49.755236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-VolumesNegativeTest-1567578667 May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 04da4360d2e74d178d1bae2c18da955e May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesNegativeTest-1567578667 May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-VolumesNegativeTest-1567578667-project May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: a0e45c8f9da34516940c9a6dc75e5758 May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-VolumesNegativeTest-1567578667-project May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1626016555", "metadata": {"Type": "work"}}} May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: May 26 20:23:49.756703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1626016555', 'metadata': {'Type': 'work'}}}} May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise error May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi '0' May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:23:49.757553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 20:23:49.767507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 20:23:49.768510 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 20:23:49.768510 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:49.768510 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cf3a74f1-298b-4056-a02b-c58e895867f7 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:23:49.773489 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cf3a74f1-298b-4056-a02b-c58e895867f7 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.030931 May 26 20:23:49.777070 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 23/50] 10.222.0.44 () {60 vars in 1155 bytes} [Thu May 26 20:23:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 20:23:49.799891 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f294e47c-23e4-4ba0-939e-1f2adbd7edc0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:49.800948 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f294e47c-23e4-4ba0-939e-1f2adbd7edc0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:49.959806 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-69783718-9412-4e47-a83b-f1ac6c871ae4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:49.967704 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f294e47c-23e4-4ba0-939e-1f2adbd7edc0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:49.972158 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-69783718-9412-4e47-a83b-f1ac6c871ae4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1295 microversion: 2.1 time: 0.298867 May 26 20:23:49.973942 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 28/51] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:49 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1295 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:49.979636 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-fac46a42-2add-4036-a941-d81f4a6f8015 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Action: 'create', calling method: .version_select at 0x7f2da4965f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-573476436", "metadata": {"Type": "work"}}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:49.985127 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f294e47c-23e4-4ba0-939e-1f2adbd7edc0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1222 microversion: 2.1 time: 0.206468 May 26 20:23:49.986017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 24/52] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:49 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1222 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-fac46a42-2add-4036-a941-d81f4a6f8015 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Request method failure captured: May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 118 May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-HUG3Fg-6QVGXOpL_MlEzwXuY3JtqB-x8LbmdbBGSCumpMKz-4dBbXSRza7dORQW40_i9AbHgGthhfHDzYCyZvgLbU_vLMJ75o0fYYYGu7A6YU_VUblFuyVx_Z7baMhhTvSdHSE93WQ_i_AsCOCaIZLi2nEpQ_y9_pslNeKv3ROHUs May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: 04da4360d2e74d178d1bae2c18da955e May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-VolumesNegativeTest-1567578667 May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:23:49.998702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-VolumesNegativeTest-1567578667 May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: 04da4360d2e74d178d1bae2c18da955e May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-VolumesNegativeTest-1567578667 May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-VolumesNegativeTest-1567578667-project May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: a0e45c8f9da34516940c9a6dc75e5758 May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-VolumesNegativeTest-1567578667-project May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-573476436", "metadata": {"Type": "work"}}} May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: May 26 20:23:50.002081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-573476436', 'metadata': {'Type': 'work'}}}} May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise error May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi '' May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:23:50.002860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 20:23:50.003949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 20:23:50.004954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 20:23:50.004954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:23:50.004954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-fac46a42-2add-4036-a941-d81f4a6f8015 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:23:50.010486 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-fac46a42-2add-4036-a941-d81f4a6f8015 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.034764 May 26 20:23:50.012905 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 29/53] 10.222.0.44 () {60 vars in 1155 bytes} [Thu May 26 20:23:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 20:23:50.026212 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-46a0aec3-04d0-4e29-b3ba-f9032918c349 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Calling method '.version_select at 0x7f2da51a7a60>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:50.213661 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2797d268-3697-4f35-9184-f76ebbb23f4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:50.215331 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2797d268-3697-4f35-9184-f76ebbb23f4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:50.254454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2797d268-3697-4f35-9184-f76ebbb23f4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:50.260326 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2797d268-3697-4f35-9184-f76ebbb23f4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:50.261488 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2797d268-3697-4f35-9184-f76ebbb23f4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:50.262271 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2797d268-3697-4f35-9184-f76ebbb23f4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:50.294743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-46a0aec3-04d0-4e29-b3ba-f9032918c349 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] HTTP exception thrown: Volume tempest-invalid-1194650602 could not be found. May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-46a0aec3-04d0-4e29-b3ba-f9032918c349 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Request method failure captured: May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1194650602 HTTP/1.1 May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HUG3Fg-6QVGXOpL_MlEzwXuY3JtqB-x8LbmdbBGSCumpMKz-4dBbXSRza7dORQW40_i9AbHgGthhfHDzYCyZvgLbU_vLMJ75o0fYYYGu7A6YU_VUblFuyVx_Z7baMhhTvSdHSE93WQ_i_AsCOCaIZLi2nEpQ_y9_pslNeKv3ROHUs May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 04da4360d2e74d178d1bae2c18da955e May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesNegativeTest-1567578667 May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:23:50.297264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-VolumesNegativeTest-1567578667 May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 04da4360d2e74d178d1bae2c18da955e May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesNegativeTest-1567578667 May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-VolumesNegativeTest-1567578667-project May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: a0e45c8f9da34516940c9a6dc75e5758 May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-VolumesNegativeTest-1567578667-project May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Volume tempest-invalid-1194650602 could not be found. May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': 'tempest-invalid-1194650602'} May 26 20:23:50.298826 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1194650602 could not be found. (HTTP 404) (Request-ID: req-8b0c10b6-5ff3-4897-91a4-d616af49e7f6) May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:50.299711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 20:23:50.302759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1194650602 could not be found. May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:23:50.305364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1194650602 could not be found. May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1194650602 could not be found. May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-46a0aec3-04d0-4e29-b3ba-f9032918c349 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Returning 404 to user: Volume tempest-invalid-1194650602 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-46a0aec3-04d0-4e29-b3ba-f9032918c349 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1194650602" status: 404 len: 99 microversion: 2.1 time: 0.278176 May 26 20:23:50.308282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 25/54] 10.222.0.44 () {58 vars in 1217 bytes} [Thu May 26 20:23:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1194650602 => generated 99 bytes in 286 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 20:23:50.311936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8f4f26bc-a7e9-4e66-bd7c-2be65a138d2d tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004745 May 26 20:23:50.338278 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 26/55] 10.222.0.44 () {58 vars in 1139 bytes} [Thu May 26 20:23:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 20:23:50.348481 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8c3a042b-d4fe-42a9-b2c4-e8e97246115a tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004304 May 26 20:23:50.372590 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 27/56] 10.222.0.44 () {58 vars in 1136 bytes} [Thu May 26 20:23:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 26 20:23:50.391062 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2334c6eb-56a7-4887-bae5-30237f3846a3 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Calling method '.version_select at 0x7f2da51a7040>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:50.734975 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-2334c6eb-56a7-4887-bae5-30237f3846a3 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] HTTP exception thrown: Volume 4f631d08-655a-4f6b-9349-204b8ef32c8e could not be found. May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2334c6eb-56a7-4887-bae5-30237f3846a3 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Request method failure captured: May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: DELETE /compute/v2.1/os-volumes/4f631d08-655a-4f6b-9349-204b8ef32c8e HTTP/1.1 May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HUG3Fg-6QVGXOpL_MlEzwXuY3JtqB-x8LbmdbBGSCumpMKz-4dBbXSRza7dORQW40_i9AbHgGthhfHDzYCyZvgLbU_vLMJ75o0fYYYGu7A6YU_VUblFuyVx_Z7baMhhTvSdHSE93WQ_i_AsCOCaIZLi2nEpQ_y9_pslNeKv3ROHUs May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 04da4360d2e74d178d1bae2c18da955e May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesNegativeTest-1567578667 May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:23:50.736970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-VolumesNegativeTest-1567578667 May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 04da4360d2e74d178d1bae2c18da955e May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesNegativeTest-1567578667 May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-VolumesNegativeTest-1567578667-project May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: a0e45c8f9da34516940c9a6dc75e5758 May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-VolumesNegativeTest-1567578667-project May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Volume 4f631d08-655a-4f6b-9349-204b8ef32c8e could not be found. May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '4f631d08-655a-4f6b-9349-204b8ef32c8e'} May 26 20:23:50.738134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f631d08-655a-4f6b-9349-204b8ef32c8e could not be found. (HTTP 404) (Request-ID: req-be4bcc17-7b1f-4cdb-9472-8906fa1d4dc2) May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:50.738855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 20:23:50.739825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f631d08-655a-4f6b-9349-204b8ef32c8e could not be found. May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 20:23:50.740857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f631d08-655a-4f6b-9349-204b8ef32c8e could not be found. May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f631d08-655a-4f6b-9349-204b8ef32c8e could not be found. May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2334c6eb-56a7-4887-bae5-30237f3846a3 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Returning 404 to user: Volume 4f631d08-655a-4f6b-9349-204b8ef32c8e could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2334c6eb-56a7-4887-bae5-30237f3846a3 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/4f631d08-655a-4f6b-9349-204b8ef32c8e" status: 404 len: 109 microversion: 2.1 time: 0.364596 May 26 20:23:50.741999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 28/57] 10.222.0.44 () {58 vars in 1247 bytes} [Thu May 26 20:23:50 2022] DELETE /compute/v2.1/os-volumes/4f631d08-655a-4f6b-9349-204b8ef32c8e => generated 109 bytes in 366 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:23:50.754275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-beba3b77-d5e2-4127-add3-35cfa725dda6 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Calling method '.version_select at 0x7f2da61ecc10>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:50.875883 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2797d268-3697-4f35-9184-f76ebbb23f4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:50.887815 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2797d268-3697-4f35-9184-f76ebbb23f4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.680305 May 26 20:23:50.888731 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 30/58] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:50 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:23:50.913329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-beba3b77-d5e2-4127-add3-35cfa725dda6 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] HTTP exception thrown: Volume bfb85d71-5d1e-4bf1-9572-c890fa4e8b6a could not be found. May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-beba3b77-d5e2-4127-add3-35cfa725dda6 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Request method failure captured: May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/os-volumes/bfb85d71-5d1e-4bf1-9572-c890fa4e8b6a HTTP/1.1 May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HUG3Fg-6QVGXOpL_MlEzwXuY3JtqB-x8LbmdbBGSCumpMKz-4dBbXSRza7dORQW40_i9AbHgGthhfHDzYCyZvgLbU_vLMJ75o0fYYYGu7A6YU_VUblFuyVx_Z7baMhhTvSdHSE93WQ_i_AsCOCaIZLi2nEpQ_y9_pslNeKv3ROHUs May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 04da4360d2e74d178d1bae2c18da955e May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesNegativeTest-1567578667 May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:23:50.917358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/04da4360d2e74d178d1bae2c18da955e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-VolumesNegativeTest-1567578667 May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 04da4360d2e74d178d1bae2c18da955e May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesNegativeTest-1567578667 May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-VolumesNegativeTest-1567578667-project May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: a0e45c8f9da34516940c9a6dc75e5758 May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-VolumesNegativeTest-1567578667-project May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Volume bfb85d71-5d1e-4bf1-9572-c890fa4e8b6a could not be found. May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': 'bfb85d71-5d1e-4bf1-9572-c890fa4e8b6a'} May 26 20:23:50.919765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bfb85d71-5d1e-4bf1-9572-c890fa4e8b6a could not be found. (HTTP 404) (Request-ID: req-069e5d09-eeca-4306-8ad2-1c1324e0238f) May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:50.921228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 20:23:50.922613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bfb85d71-5d1e-4bf1-9572-c890fa4e8b6a could not be found. May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 20:23:50.923832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bfb85d71-5d1e-4bf1-9572-c890fa4e8b6a could not be found. May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bfb85d71-5d1e-4bf1-9572-c890fa4e8b6a could not be found. May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-beba3b77-d5e2-4127-add3-35cfa725dda6 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] Returning 404 to user: Volume bfb85d71-5d1e-4bf1-9572-c890fa4e8b6a could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-beba3b77-d5e2-4127-add3-35cfa725dda6 tempest-VolumesNegativeTest-1567578667 tempest-VolumesNegativeTest-1567578667-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/bfb85d71-5d1e-4bf1-9572-c890fa4e8b6a" status: 404 len: 109 microversion: 2.1 time: 0.173745 May 26 20:23:50.925121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 29/59] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:23:50 2022] GET /compute/v2.1/os-volumes/bfb85d71-5d1e-4bf1-9572-c890fa4e8b6a => generated 109 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:23:50.991090 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-763a12ae-b96e-4f8f-887b-f932ed14b685 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:50.991717 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-763a12ae-b96e-4f8f-887b-f932ed14b685 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:51.003798 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8a194de2-2b40-4b4f-9c7d-1313438388c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:51.004420 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8a194de2-2b40-4b4f-9c7d-1313438388c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:51.015902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-763a12ae-b96e-4f8f-887b-f932ed14b685 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:51.016390 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-763a12ae-b96e-4f8f-887b-f932ed14b685 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:51.017188 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-763a12ae-b96e-4f8f-887b-f932ed14b685 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:51.017636 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-763a12ae-b96e-4f8f-887b-f932ed14b685 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:51.025243 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8a194de2-2b40-4b4f-9c7d-1313438388c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:51.028759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8a194de2-2b40-4b4f-9c7d-1313438388c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:51.028759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8a194de2-2b40-4b4f-9c7d-1313438388c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:51.028759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8a194de2-2b40-4b4f-9c7d-1313438388c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:51.267372 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-763a12ae-b96e-4f8f-887b-f932ed14b685 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:51.281099 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-8a194de2-2b40-4b4f-9c7d-1313438388c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:51.286715 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-763a12ae-b96e-4f8f-887b-f932ed14b685 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1293 microversion: 2.1 time: 0.297831 May 26 20:23:51.295850 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 31/60] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:50 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1293 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:51.315481 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8a194de2-2b40-4b4f-9c7d-1313438388c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1274 microversion: 2.1 time: 0.310094 May 26 20:23:51.348184 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 30/61] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:50 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1274 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:23:51.910035 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1ec556db-f93e-4a33-bd50-85cb2b14ed90 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:51.911839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-1ec556db-f93e-4a33-bd50-85cb2b14ed90 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:51.925737 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1ec556db-f93e-4a33-bd50-85cb2b14ed90 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:51.930373 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1ec556db-f93e-4a33-bd50-85cb2b14ed90 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:51.932413 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1ec556db-f93e-4a33-bd50-85cb2b14ed90 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:51.934140 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1ec556db-f93e-4a33-bd50-85cb2b14ed90 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:52.303827 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9e86dcfd-32d3-4b61-92ba-a599eba4dd1b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:52.305064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9e86dcfd-32d3-4b61-92ba-a599eba4dd1b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:52.315804 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9e86dcfd-32d3-4b61-92ba-a599eba4dd1b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:52.320551 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9e86dcfd-32d3-4b61-92ba-a599eba4dd1b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:52.321933 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9e86dcfd-32d3-4b61-92ba-a599eba4dd1b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:52.322893 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9e86dcfd-32d3-4b61-92ba-a599eba4dd1b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:52.431362 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1ec556db-f93e-4a33-bd50-85cb2b14ed90 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:52.451648 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1ec556db-f93e-4a33-bd50-85cb2b14ed90 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.549839 May 26 20:23:52.463009 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 32/62] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:51 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:52.469050 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8335b543-4080-45bc-b796-63fc2e16e6bb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:52.469915 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8335b543-4080-45bc-b796-63fc2e16e6bb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:52.477023 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8335b543-4080-45bc-b796-63fc2e16e6bb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:52.477741 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8335b543-4080-45bc-b796-63fc2e16e6bb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:52.478691 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8335b543-4080-45bc-b796-63fc2e16e6bb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:52.479285 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8335b543-4080-45bc-b796-63fc2e16e6bb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:52.554903 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9e86dcfd-32d3-4b61-92ba-a599eba4dd1b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:52.564571 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9e86dcfd-32d3-4b61-92ba-a599eba4dd1b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1293 microversion: 2.1 time: 0.265385 May 26 20:23:52.574581 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 31/63] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:52 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1293 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:52.657455 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8335b543-4080-45bc-b796-63fc2e16e6bb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:52.669126 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8335b543-4080-45bc-b796-63fc2e16e6bb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1292 microversion: 2.1 time: 0.204643 May 26 20:23:52.670618 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 33/64] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:52 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1292 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:53.469820 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a6f77c16-593c-4916-972d-dbd43b459e30 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:53.471033 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a6f77c16-593c-4916-972d-dbd43b459e30 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:53.484846 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a6f77c16-593c-4916-972d-dbd43b459e30 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:53.485611 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a6f77c16-593c-4916-972d-dbd43b459e30 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:53.486741 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a6f77c16-593c-4916-972d-dbd43b459e30 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:53.487330 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a6f77c16-593c-4916-972d-dbd43b459e30 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:53.592913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-3a47701e-d8c3-4304-8ae8-296267cefd6d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:53.593784 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3a47701e-d8c3-4304-8ae8-296267cefd6d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:53.599901 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3a47701e-d8c3-4304-8ae8-296267cefd6d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:53.600347 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3a47701e-d8c3-4304-8ae8-296267cefd6d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:53.601105 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3a47701e-d8c3-4304-8ae8-296267cefd6d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:53.601534 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3a47701e-d8c3-4304-8ae8-296267cefd6d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:53.763780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-3a47701e-d8c3-4304-8ae8-296267cefd6d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:53.773490 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-3a47701e-d8c3-4304-8ae8-296267cefd6d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.186650 May 26 20:23:53.774168 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 34/65] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:53 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:23:53.785675 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6fcd0df4-ad19-47b8-a90a-df2f37c66f46 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:53.788387 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6fcd0df4-ad19-47b8-a90a-df2f37c66f46 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:53.796059 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6fcd0df4-ad19-47b8-a90a-df2f37c66f46 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:53.796897 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6fcd0df4-ad19-47b8-a90a-df2f37c66f46 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:53.798175 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6fcd0df4-ad19-47b8-a90a-df2f37c66f46 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:53.798927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6fcd0df4-ad19-47b8-a90a-df2f37c66f46 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:53.890053 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a6f77c16-593c-4916-972d-dbd43b459e30 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:53.896836 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6fcd0df4-ad19-47b8-a90a-df2f37c66f46 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:53.898596 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a6f77c16-593c-4916-972d-dbd43b459e30 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.434118 May 26 20:23:53.909789 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 32/66] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:53 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:53.910982 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6fcd0df4-ad19-47b8-a90a-df2f37c66f46 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1280 microversion: 2.1 time: 0.135617 May 26 20:23:53.911839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 35/67] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:53 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1280 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:54.798515 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-61585991-6802-4c72-be59-b9f99c33e88b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:54.799760 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-61585991-6802-4c72-be59-b9f99c33e88b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:54.806225 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61585991-6802-4c72-be59-b9f99c33e88b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:54.806696 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61585991-6802-4c72-be59-b9f99c33e88b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:54.807463 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61585991-6802-4c72-be59-b9f99c33e88b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:54.807898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61585991-6802-4c72-be59-b9f99c33e88b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:54.918892 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:54.923850 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1f411265-f30b-4ef6-b1bf-ad248b390c3f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:54.924462 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-1f411265-f30b-4ef6-b1bf-ad248b390c3f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:54.934831 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1f411265-f30b-4ef6-b1bf-ad248b390c3f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:54.935285 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1f411265-f30b-4ef6-b1bf-ad248b390c3f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:54.936046 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1f411265-f30b-4ef6-b1bf-ad248b390c3f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:54.936475 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1f411265-f30b-4ef6-b1bf-ad248b390c3f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:54.959478 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-61585991-6802-4c72-be59-b9f99c33e88b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:54.970591 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-61585991-6802-4c72-be59-b9f99c33e88b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.180161 May 26 20:23:54.982099 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 33/68] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:54 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:54.990830 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-47998bc7-ec03-4efe-bfb1-4bb0519d1055 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:54.997053 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-47998bc7-ec03-4efe-bfb1-4bb0519d1055 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:54.998984 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47998bc7-ec03-4efe-bfb1-4bb0519d1055 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:54.999610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47998bc7-ec03-4efe-bfb1-4bb0519d1055 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:55.000981 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47998bc7-ec03-4efe-bfb1-4bb0519d1055 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:55.001768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47998bc7-ec03-4efe-bfb1-4bb0519d1055 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:55.101509 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1f411265-f30b-4ef6-b1bf-ad248b390c3f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:55.110605 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1f411265-f30b-4ef6-b1bf-ad248b390c3f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.194044 May 26 20:23:55.112937 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 36/69] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:54 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:55.157413 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-47998bc7-ec03-4efe-bfb1-4bb0519d1055 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:55.186954 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-47998bc7-ec03-4efe-bfb1-4bb0519d1055 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.199368 May 26 20:23:55.186954 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 34/70] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:54 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:55.993141 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-572702c9-5d56-4591-856a-929a64175c76 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:55.993642 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-572702c9-5d56-4591-856a-929a64175c76 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:56.004579 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-572702c9-5d56-4591-856a-929a64175c76 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:56.005677 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-572702c9-5d56-4591-856a-929a64175c76 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:56.006819 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-572702c9-5d56-4591-856a-929a64175c76 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:56.007326 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-572702c9-5d56-4591-856a-929a64175c76 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:56.143999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-186ddbb0-74ad-46f7-8cf2-f2f1290fa79d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:56.144632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-186ddbb0-74ad-46f7-8cf2-f2f1290fa79d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:56.154102 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-186ddbb0-74ad-46f7-8cf2-f2f1290fa79d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:56.154583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-186ddbb0-74ad-46f7-8cf2-f2f1290fa79d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:56.155386 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-186ddbb0-74ad-46f7-8cf2-f2f1290fa79d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:56.155840 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-186ddbb0-74ad-46f7-8cf2-f2f1290fa79d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:56.272721 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-572702c9-5d56-4591-856a-929a64175c76 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:56.303914 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-572702c9-5d56-4591-856a-929a64175c76 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.318012 May 26 20:23:56.305140 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 37/71] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:55 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:56.312506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c9686f81-1d4f-4e8e-955b-c64bbcb76f0f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:56.313674 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c9686f81-1d4f-4e8e-955b-c64bbcb76f0f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:56.321543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c9686f81-1d4f-4e8e-955b-c64bbcb76f0f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:56.322397 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c9686f81-1d4f-4e8e-955b-c64bbcb76f0f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:56.323610 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c9686f81-1d4f-4e8e-955b-c64bbcb76f0f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:56.324221 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c9686f81-1d4f-4e8e-955b-c64bbcb76f0f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:56.630922 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-186ddbb0-74ad-46f7-8cf2-f2f1290fa79d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:56.634978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c9686f81-1d4f-4e8e-955b-c64bbcb76f0f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:56.639322 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=100 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:56.644867 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-186ddbb0-74ad-46f7-8cf2-f2f1290fa79d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.515858 May 26 20:23:56.646775 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 35/72] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:56 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:56.646894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c9686f81-1d4f-4e8e-955b-c64bbcb76f0f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.339045 May 26 20:23:56.646894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 38/73] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:56 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:57.328671 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-07edacfa-e9ea-4439-b7d9-bec2d6eecb21 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:57.328671 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-07edacfa-e9ea-4439-b7d9-bec2d6eecb21 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:57.349977 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07edacfa-e9ea-4439-b7d9-bec2d6eecb21 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:57.351674 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07edacfa-e9ea-4439-b7d9-bec2d6eecb21 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:57.357719 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07edacfa-e9ea-4439-b7d9-bec2d6eecb21 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:57.360623 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-07edacfa-e9ea-4439-b7d9-bec2d6eecb21 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:57.684379 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-34099c55-24fe-4df7-a268-8eba44d1f8c2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:57.687137 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-34099c55-24fe-4df7-a268-8eba44d1f8c2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:57.720502 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:57.724598 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-34099c55-24fe-4df7-a268-8eba44d1f8c2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:57.725105 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-34099c55-24fe-4df7-a268-8eba44d1f8c2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:57.726065 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-34099c55-24fe-4df7-a268-8eba44d1f8c2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:57.734642 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-34099c55-24fe-4df7-a268-8eba44d1f8c2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:57.998973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-07edacfa-e9ea-4439-b7d9-bec2d6eecb21 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:58.009383 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-07edacfa-e9ea-4439-b7d9-bec2d6eecb21 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.691144 May 26 20:23:58.010854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 36/74] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:57 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:58.017184 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-99fe26a8-a445-4bda-8d95-30cd1d12bda3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:58.018017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-99fe26a8-a445-4bda-8d95-30cd1d12bda3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:58.027231 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99fe26a8-a445-4bda-8d95-30cd1d12bda3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:58.028786 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99fe26a8-a445-4bda-8d95-30cd1d12bda3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:58.029805 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99fe26a8-a445-4bda-8d95-30cd1d12bda3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:58.030270 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99fe26a8-a445-4bda-8d95-30cd1d12bda3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:58.074085 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-34099c55-24fe-4df7-a268-8eba44d1f8c2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:58.104677 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-34099c55-24fe-4df7-a268-8eba44d1f8c2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.436360 May 26 20:23:58.111134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 39/75] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:57 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:58.236678 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-99fe26a8-a445-4bda-8d95-30cd1d12bda3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:58.248043 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-99fe26a8-a445-4bda-8d95-30cd1d12bda3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.235799 May 26 20:23:58.248832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 37/76] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:58 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:58.344768 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-9e093cb8-2cfc-498f-96e8-433951f7b711 req-f19d189f-372e-4fa3-b3ed-33363efe014a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f23bb01-825e-4dcf-a2a0-e75b6c8928ab", "tag": "fd4a262c-5c5f-4b05-ac17-c0c6aed612e9"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:58.384206 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-9e093cb8-2cfc-498f-96e8-433951f7b711 req-f19d189f-372e-4fa3-b3ed-33363efe014a service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:58.389506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-9e093cb8-2cfc-498f-96e8-433951f7b711 req-f19d189f-372e-4fa3-b3ed-33363efe014a service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:58.429654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-9e093cb8-2cfc-498f-96e8-433951f7b711 req-f19d189f-372e-4fa3-b3ed-33363efe014a service nova] Creating event network-changed:fd4a262c-5c5f-4b05-ac17-c0c6aed612e9 for instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab on hv-cinder-84213 May 26 20:23:58.431219 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-9e093cb8-2cfc-498f-96e8-433951f7b711 req-f19d189f-372e-4fa3-b3ed-33363efe014a service nova] Acquired lock "compute-rpcapi-router" {{(pid=118306) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 20:23:58.432811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ffab9df-b58c-4bc5-91ab-7eea571ebdcb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:58.433485 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ffab9df-b58c-4bc5-91ab-7eea571ebdcb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:58.434876 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ffab9df-b58c-4bc5-91ab-7eea571ebdcb None None] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:58.435557 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ffab9df-b58c-4bc5-91ab-7eea571ebdcb None None] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:58.446798 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.compute.rpcapi [None req-8ffab9df-b58c-4bc5-91ab-7eea571ebdcb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 20:23:58.448122 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ffab9df-b58c-4bc5-91ab-7eea571ebdcb None None] Releasing lock "compute-rpcapi-router" {{(pid=118306) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 20:23:58.482652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8ffab9df-b58c-4bc5-91ab-7eea571ebdcb None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142683 May 26 20:23:58.484235 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 40/77] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:23:59.030298 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8da8d448-8a53-44db-ae00-f09627c5944f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:59.031592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8da8d448-8a53-44db-ae00-f09627c5944f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:59.040976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8da8d448-8a53-44db-ae00-f09627c5944f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:59.040976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8da8d448-8a53-44db-ae00-f09627c5944f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:59.040976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8da8d448-8a53-44db-ae00-f09627c5944f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:59.040976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8da8d448-8a53-44db-ae00-f09627c5944f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:59.125387 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=26 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:59.131055 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c1b7cdad-bd8d-444c-89f5-33501d675daf tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:59.131806 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c1b7cdad-bd8d-444c-89f5-33501d675daf tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:59.147381 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c1b7cdad-bd8d-444c-89f5-33501d675daf tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:59.147830 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c1b7cdad-bd8d-444c-89f5-33501d675daf tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:59.148610 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c1b7cdad-bd8d-444c-89f5-33501d675daf tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:59.149041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c1b7cdad-bd8d-444c-89f5-33501d675daf tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:59.419040 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-8da8d448-8a53-44db-ae00-f09627c5944f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:59.423203 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=79 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:59.425470 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8da8d448-8a53-44db-ae00-f09627c5944f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.400221 May 26 20:23:59.436326 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 38/78] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:59 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:23:59.442082 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e36116a2-f7d1-46a7-9b39-ddf1dc4d8579 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:23:59.443017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e36116a2-f7d1-46a7-9b39-ddf1dc4d8579 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:23:59.451389 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:59.453359 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e36116a2-f7d1-46a7-9b39-ddf1dc4d8579 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:59.454000 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e36116a2-f7d1-46a7-9b39-ddf1dc4d8579 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:59.454979 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e36116a2-f7d1-46a7-9b39-ddf1dc4d8579 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:59.456872 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e36116a2-f7d1-46a7-9b39-ddf1dc4d8579 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:59.636129 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:59.660081 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e36116a2-f7d1-46a7-9b39-ddf1dc4d8579 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:59.669278 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e36116a2-f7d1-46a7-9b39-ddf1dc4d8579 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.231611 May 26 20:23:59.681775 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 39/79] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:59 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:23:59.759975 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c1b7cdad-bd8d-444c-89f5-33501d675daf tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:23:59.771977 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c1b7cdad-bd8d-444c-89f5-33501d675daf tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.646265 May 26 20:23:59.772114 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-6fc84333-fc2d-4375-859b-185ba0e8a10b req-fc1d6445-3677-4e7c-8823-3b4ce243dfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50b0640b-f71f-43b5-b9c6-bac52df82796", "tag": "f7c54df1-d39f-4aff-83be-3bcd00c8c9cd"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:23:59.780920 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-6fc84333-fc2d-4375-859b-185ba0e8a10b req-fc1d6445-3677-4e7c-8823-3b4ce243dfe2 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:23:59.781100 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 41/80] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:23:59 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:23:59.781366 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-6fc84333-fc2d-4375-859b-185ba0e8a10b req-fc1d6445-3677-4e7c-8823-3b4ce243dfe2 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:23:59.793405 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-6fc84333-fc2d-4375-859b-185ba0e8a10b req-fc1d6445-3677-4e7c-8823-3b4ce243dfe2 service nova] Creating event network-changed:f7c54df1-d39f-4aff-83be-3bcd00c8c9cd for instance 50b0640b-f71f-43b5-b9c6-bac52df82796 on hv-cinder-84213 May 26 20:23:59.799414 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-6fc84333-fc2d-4375-859b-185ba0e8a10b req-fc1d6445-3677-4e7c-8823-3b4ce243dfe2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114626 May 26 20:23:59.800107 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 40/81] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:24:00.443232 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-f7c53ed0-45dd-4b04-8583-197f9037aba2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:00.444550 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-f7c53ed0-45dd-4b04-8583-197f9037aba2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:00.453856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f7c53ed0-45dd-4b04-8583-197f9037aba2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:00.454478 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f7c53ed0-45dd-4b04-8583-197f9037aba2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:00.455407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f7c53ed0-45dd-4b04-8583-197f9037aba2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:00.455838 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f7c53ed0-45dd-4b04-8583-197f9037aba2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:00.614700 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-f7c53ed0-45dd-4b04-8583-197f9037aba2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:00.634867 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-f7c53ed0-45dd-4b04-8583-197f9037aba2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.184312 May 26 20:24:00.634867 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 42/82] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:00 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:00.695214 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=18 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:00.700015 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-82811186-f418-4d4c-a234-ec44617ebbed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:00.700810 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-82811186-f418-4d4c-a234-ec44617ebbed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:00.709109 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82811186-f418-4d4c-a234-ec44617ebbed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:00.709812 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82811186-f418-4d4c-a234-ec44617ebbed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:00.710794 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82811186-f418-4d4c-a234-ec44617ebbed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:00.711387 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-82811186-f418-4d4c-a234-ec44617ebbed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:00.788041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0605d5dc-72c3-4753-80fe-a1f01c9b96e1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:00.788932 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0605d5dc-72c3-4753-80fe-a1f01c9b96e1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:00.796192 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0605d5dc-72c3-4753-80fe-a1f01c9b96e1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:00.796774 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0605d5dc-72c3-4753-80fe-a1f01c9b96e1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:00.797712 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0605d5dc-72c3-4753-80fe-a1f01c9b96e1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:00.798150 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0605d5dc-72c3-4753-80fe-a1f01c9b96e1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:00.849311 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-82811186-f418-4d4c-a234-ec44617ebbed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:00.857602 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-82811186-f418-4d4c-a234-ec44617ebbed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.163302 May 26 20:24:00.858178 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 41/83] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:00 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:00.935637 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-0605d5dc-72c3-4753-80fe-a1f01c9b96e1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:00.944289 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0605d5dc-72c3-4753-80fe-a1f01c9b96e1 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.160711 May 26 20:24:00.953490 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 43/84] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:00 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:24:01.644852 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b127f471-91e5-4935-9e3b-878962073031 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:01.645801 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b127f471-91e5-4935-9e3b-878962073031 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:01.652502 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b127f471-91e5-4935-9e3b-878962073031 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:01.653103 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b127f471-91e5-4935-9e3b-878962073031 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:01.654040 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b127f471-91e5-4935-9e3b-878962073031 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:01.654517 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b127f471-91e5-4935-9e3b-878962073031 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:01.819745 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-ca23b18b-7ab6-4ab0-9f1e-720354149fdf req-b8465de9-17c6-4366-96d7-d17191615ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f", "tag": "ed56f181-3869-4093-b872-aca46d220d93"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:24:01.828714 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-ca23b18b-7ab6-4ab0-9f1e-720354149fdf req-b8465de9-17c6-4366-96d7-d17191615ac1 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:01.829156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-ca23b18b-7ab6-4ab0-9f1e-720354149fdf req-b8465de9-17c6-4366-96d7-d17191615ac1 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:01.841484 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-ca23b18b-7ab6-4ab0-9f1e-720354149fdf req-b8465de9-17c6-4366-96d7-d17191615ac1 service nova] Creating event network-changed:ed56f181-3869-4093-b872-aca46d220d93 for instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f on hv-cinder-84213 May 26 20:24:01.850295 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-ca23b18b-7ab6-4ab0-9f1e-720354149fdf req-b8465de9-17c6-4366-96d7-d17191615ac1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030895 May 26 20:24:01.850295 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 44/85] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:24:01.852939 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b127f471-91e5-4935-9e3b-878962073031 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:01.861246 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b127f471-91e5-4935-9e3b-878962073031 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.220855 May 26 20:24:01.862098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 42/86] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:01 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:01.876237 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-df918dfe-70d3-4b15-bf18-55c764560f61 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:01.876941 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-df918dfe-70d3-4b15-bf18-55c764560f61 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:01.883451 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-df918dfe-70d3-4b15-bf18-55c764560f61 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:01.883909 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-df918dfe-70d3-4b15-bf18-55c764560f61 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:01.884798 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-df918dfe-70d3-4b15-bf18-55c764560f61 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:01.885240 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-df918dfe-70d3-4b15-bf18-55c764560f61 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:01.962963 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3e944891-e28a-4ec9-9ae5-b21b7861b18d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:01.963813 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3e944891-e28a-4ec9-9ae5-b21b7861b18d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:01.971204 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e944891-e28a-4ec9-9ae5-b21b7861b18d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:01.972207 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e944891-e28a-4ec9-9ae5-b21b7861b18d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:01.973289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e944891-e28a-4ec9-9ae5-b21b7861b18d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:01.973757 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e944891-e28a-4ec9-9ae5-b21b7861b18d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:02.045211 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-df918dfe-70d3-4b15-bf18-55c764560f61 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:02.053206 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-df918dfe-70d3-4b15-bf18-55c764560f61 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.181979 May 26 20:24:02.053812 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 45/87] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:01 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:02.174878 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-3e944891-e28a-4ec9-9ae5-b21b7861b18d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:02.186759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3e944891-e28a-4ec9-9ae5-b21b7861b18d tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.228086 May 26 20:24:02.187547 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 43/88] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:01 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:24:02.877672 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-80357669-8706-4c58-8059-5635cac6918a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:02.879178 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-80357669-8706-4c58-8059-5635cac6918a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:02.888593 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-80357669-8706-4c58-8059-5635cac6918a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:02.888988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-80357669-8706-4c58-8059-5635cac6918a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:02.890076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-80357669-8706-4c58-8059-5635cac6918a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:02.890601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-80357669-8706-4c58-8059-5635cac6918a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:03.071677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d76a6a6b-810a-4fab-a730-055bfba31fdc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:03.072256 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d76a6a6b-810a-4fab-a730-055bfba31fdc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:03.082034 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d76a6a6b-810a-4fab-a730-055bfba31fdc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:03.082507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d76a6a6b-810a-4fab-a730-055bfba31fdc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:03.083361 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d76a6a6b-810a-4fab-a730-055bfba31fdc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:03.083969 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d76a6a6b-810a-4fab-a730-055bfba31fdc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:03.219676 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-80357669-8706-4c58-8059-5635cac6918a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:03.232095 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-80357669-8706-4c58-8059-5635cac6918a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.357941 May 26 20:24:03.232694 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 46/89] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:02 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:03.249080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a4c9b421-c220-4b9e-9ad5-3467800c70a7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:03.249080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a4c9b421-c220-4b9e-9ad5-3467800c70a7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:03.259684 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a4c9b421-c220-4b9e-9ad5-3467800c70a7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:03.260301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a4c9b421-c220-4b9e-9ad5-3467800c70a7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:03.261445 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a4c9b421-c220-4b9e-9ad5-3467800c70a7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:03.263438 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a4c9b421-c220-4b9e-9ad5-3467800c70a7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:03.610300 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a4c9b421-c220-4b9e-9ad5-3467800c70a7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:03.610300 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a4c9b421-c220-4b9e-9ad5-3467800c70a7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.321120 May 26 20:24:03.610300 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 47/90] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:03 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:03.753507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-d76a6a6b-810a-4fab-a730-055bfba31fdc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:03.766786 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d76a6a6b-810a-4fab-a730-055bfba31fdc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.699777 May 26 20:24:03.767357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 44/91] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:03 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:24:04.249446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-faded465-9c7a-4ce5-a9e4-088100fdafd6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:04.250618 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-faded465-9c7a-4ce5-a9e4-088100fdafd6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:04.256820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-faded465-9c7a-4ce5-a9e4-088100fdafd6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:04.257259 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-faded465-9c7a-4ce5-a9e4-088100fdafd6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:04.258044 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-faded465-9c7a-4ce5-a9e4-088100fdafd6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:04.258647 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-faded465-9c7a-4ce5-a9e4-088100fdafd6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:04.406576 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-faded465-9c7a-4ce5-a9e4-088100fdafd6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:04.417222 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-faded465-9c7a-4ce5-a9e4-088100fdafd6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.171875 May 26 20:24:04.418623 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 48/92] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:04 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:04.623340 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-49582efa-1e34-41a4-a181-e3c8ca4baf55 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:04.623969 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-49582efa-1e34-41a4-a181-e3c8ca4baf55 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:04.630022 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49582efa-1e34-41a4-a181-e3c8ca4baf55 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:04.630508 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49582efa-1e34-41a4-a181-e3c8ca4baf55 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:04.631271 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49582efa-1e34-41a4-a181-e3c8ca4baf55 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:04.631708 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49582efa-1e34-41a4-a181-e3c8ca4baf55 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:04.784790 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-edfec104-7cbc-4a7f-8b92-efff3d45ae74 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:04.794220 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-edfec104-7cbc-4a7f-8b92-efff3d45ae74 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:04.794588 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-49582efa-1e34-41a4-a181-e3c8ca4baf55 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:04.794692 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-edfec104-7cbc-4a7f-8b92-efff3d45ae74 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:04.795073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-edfec104-7cbc-4a7f-8b92-efff3d45ae74 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:04.795863 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-edfec104-7cbc-4a7f-8b92-efff3d45ae74 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:04.796302 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-edfec104-7cbc-4a7f-8b92-efff3d45ae74 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:04.811405 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-49582efa-1e34-41a4-a181-e3c8ca4baf55 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.192116 May 26 20:24:04.814397 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 45/93] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:04 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:04.942704 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-edfec104-7cbc-4a7f-8b92-efff3d45ae74 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:04.951021 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-edfec104-7cbc-4a7f-8b92-efff3d45ae74 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.170523 May 26 20:24:04.951683 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 49/94] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:04 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:05.437592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-47387b02-9fa1-4dc0-a480-acfbcd962fa7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:05.438203 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-47387b02-9fa1-4dc0-a480-acfbcd962fa7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:05.444627 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47387b02-9fa1-4dc0-a480-acfbcd962fa7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:05.445014 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47387b02-9fa1-4dc0-a480-acfbcd962fa7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:05.445828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47387b02-9fa1-4dc0-a480-acfbcd962fa7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:05.446295 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-47387b02-9fa1-4dc0-a480-acfbcd962fa7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:05.587453 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-47387b02-9fa1-4dc0-a480-acfbcd962fa7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:05.597011 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-47387b02-9fa1-4dc0-a480-acfbcd962fa7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.163809 May 26 20:24:05.597583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 46/95] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:05 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:05.827725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-70212fec-32b9-436c-a9f7-308e9d6bd337 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:05.828345 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-70212fec-32b9-436c-a9f7-308e9d6bd337 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:05.834579 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-70212fec-32b9-436c-a9f7-308e9d6bd337 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:05.835031 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-70212fec-32b9-436c-a9f7-308e9d6bd337 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:05.835794 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-70212fec-32b9-436c-a9f7-308e9d6bd337 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:05.836300 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-70212fec-32b9-436c-a9f7-308e9d6bd337 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:05.968908 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-17f9f2d4-6729-450a-b75d-c1870260f4e4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:05.969994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-17f9f2d4-6729-450a-b75d-c1870260f4e4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:05.976745 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17f9f2d4-6729-450a-b75d-c1870260f4e4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:05.977637 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17f9f2d4-6729-450a-b75d-c1870260f4e4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:05.978552 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17f9f2d4-6729-450a-b75d-c1870260f4e4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:05.979115 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17f9f2d4-6729-450a-b75d-c1870260f4e4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:05.993853 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-70212fec-32b9-436c-a9f7-308e9d6bd337 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:06.017549 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-70212fec-32b9-436c-a9f7-308e9d6bd337 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.193567 May 26 20:24:06.021268 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 50/96] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:05 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:06.170022 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-17f9f2d4-6729-450a-b75d-c1870260f4e4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:06.178844 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-17f9f2d4-6729-450a-b75d-c1870260f4e4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.214764 May 26 20:24:06.182466 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 47/97] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:05 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:24:06.616918 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ea02b429-336f-4368-891d-affb5e40e154 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:06.616918 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ea02b429-336f-4368-891d-affb5e40e154 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:06.622040 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ea02b429-336f-4368-891d-affb5e40e154 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:06.622525 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ea02b429-336f-4368-891d-affb5e40e154 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:06.623302 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ea02b429-336f-4368-891d-affb5e40e154 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:06.623739 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ea02b429-336f-4368-891d-affb5e40e154 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:06.771149 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ea02b429-336f-4368-891d-affb5e40e154 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:06.779799 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ea02b429-336f-4368-891d-affb5e40e154 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.169840 May 26 20:24:06.780379 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 51/98] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:06 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:24:07.036271 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-491b647e-2b03-4cef-98a1-caa563d27b83 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:07.036876 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-491b647e-2b03-4cef-98a1-caa563d27b83 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:07.043617 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-491b647e-2b03-4cef-98a1-caa563d27b83 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:07.044201 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-491b647e-2b03-4cef-98a1-caa563d27b83 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:07.044972 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-491b647e-2b03-4cef-98a1-caa563d27b83 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:07.045315 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-491b647e-2b03-4cef-98a1-caa563d27b83 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:07.176652 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-491b647e-2b03-4cef-98a1-caa563d27b83 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:07.184786 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-491b647e-2b03-4cef-98a1-caa563d27b83 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.152774 May 26 20:24:07.185353 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 48/99] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:07 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:07.196609 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1e42db0c-0f1a-4a5c-993f-e4f3635192ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:07.197229 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-1e42db0c-0f1a-4a5c-993f-e4f3635192ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:07.204067 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1e42db0c-0f1a-4a5c-993f-e4f3635192ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:07.204717 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1e42db0c-0f1a-4a5c-993f-e4f3635192ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:07.205487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1e42db0c-0f1a-4a5c-993f-e4f3635192ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:07.205922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1e42db0c-0f1a-4a5c-993f-e4f3635192ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:07.350015 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1e42db0c-0f1a-4a5c-993f-e4f3635192ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:07.361893 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1e42db0c-0f1a-4a5c-993f-e4f3635192ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.169164 May 26 20:24:07.362495 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 52/100] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:07 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:07.797130 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-dac59195-3e6a-4647-8c86-6d653cc92e26 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:07.797745 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dac59195-3e6a-4647-8c86-6d653cc92e26 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:07.804439 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac59195-3e6a-4647-8c86-6d653cc92e26 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:07.804439 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac59195-3e6a-4647-8c86-6d653cc92e26 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:07.805214 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac59195-3e6a-4647-8c86-6d653cc92e26 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:07.805642 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dac59195-3e6a-4647-8c86-6d653cc92e26 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:07.948599 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-dac59195-3e6a-4647-8c86-6d653cc92e26 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:07.962568 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-dac59195-3e6a-4647-8c86-6d653cc92e26 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.170342 May 26 20:24:07.963244 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 49/101] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:07 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:08.202169 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-95c0e5ec-3cd5-401e-acbc-f8f4100ff57a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:08.202808 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-95c0e5ec-3cd5-401e-acbc-f8f4100ff57a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:08.208833 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-95c0e5ec-3cd5-401e-acbc-f8f4100ff57a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:08.212428 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-95c0e5ec-3cd5-401e-acbc-f8f4100ff57a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:08.212428 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-95c0e5ec-3cd5-401e-acbc-f8f4100ff57a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:08.212428 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-95c0e5ec-3cd5-401e-acbc-f8f4100ff57a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:08.342292 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-95c0e5ec-3cd5-401e-acbc-f8f4100ff57a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:08.350747 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-95c0e5ec-3cd5-401e-acbc-f8f4100ff57a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.152873 May 26 20:24:08.350938 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 53/102] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:08 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:08.380763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6e100d45-c24b-46fc-9e3d-4a4fa9f7a3de tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:08.383115 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6e100d45-c24b-46fc-9e3d-4a4fa9f7a3de tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:08.388444 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e100d45-c24b-46fc-9e3d-4a4fa9f7a3de tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:08.388898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e100d45-c24b-46fc-9e3d-4a4fa9f7a3de tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:08.389662 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e100d45-c24b-46fc-9e3d-4a4fa9f7a3de tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:08.390095 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e100d45-c24b-46fc-9e3d-4a4fa9f7a3de tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:08.773744 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6e100d45-c24b-46fc-9e3d-4a4fa9f7a3de tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:08.776768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6e100d45-c24b-46fc-9e3d-4a4fa9f7a3de tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.399579 May 26 20:24:08.777407 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 50/103] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:08 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:08.985359 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7e54e5d3-cb9e-4fbe-9d9f-4f128fc4a189 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:08.985769 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7e54e5d3-cb9e-4fbe-9d9f-4f128fc4a189 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:08.987788 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:08.994822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7e54e5d3-cb9e-4fbe-9d9f-4f128fc4a189 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:08.995556 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7e54e5d3-cb9e-4fbe-9d9f-4f128fc4a189 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:08.998688 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7e54e5d3-cb9e-4fbe-9d9f-4f128fc4a189 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:09.000143 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7e54e5d3-cb9e-4fbe-9d9f-4f128fc4a189 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:09.155699 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7e54e5d3-cb9e-4fbe-9d9f-4f128fc4a189 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:09.163350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7e54e5d3-cb9e-4fbe-9d9f-4f128fc4a189 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.186249 May 26 20:24:09.163926 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 54/104] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:08 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:09.369866 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b63ce32c-b813-4efb-a720-7301c7cd25dd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:09.371453 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b63ce32c-b813-4efb-a720-7301c7cd25dd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:09.391435 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b63ce32c-b813-4efb-a720-7301c7cd25dd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:09.391978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b63ce32c-b813-4efb-a720-7301c7cd25dd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:09.393016 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b63ce32c-b813-4efb-a720-7301c7cd25dd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:09.393515 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b63ce32c-b813-4efb-a720-7301c7cd25dd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:09.545841 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b63ce32c-b813-4efb-a720-7301c7cd25dd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:09.553675 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b63ce32c-b813-4efb-a720-7301c7cd25dd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.188806 May 26 20:24:09.554302 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 51/105] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:09 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:09.794710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-718042fb-7f26-4aeb-b24f-d62e04252bee tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:09.795553 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-718042fb-7f26-4aeb-b24f-d62e04252bee tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:09.801694 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-718042fb-7f26-4aeb-b24f-d62e04252bee tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:09.802208 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-718042fb-7f26-4aeb-b24f-d62e04252bee tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:09.803023 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-718042fb-7f26-4aeb-b24f-d62e04252bee tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:09.803457 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-718042fb-7f26-4aeb-b24f-d62e04252bee tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:10.012380 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-718042fb-7f26-4aeb-b24f-d62e04252bee tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:10.025922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-718042fb-7f26-4aeb-b24f-d62e04252bee tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.236608 May 26 20:24:10.028434 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 55/106] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:09 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:10.145014 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-1e301243-b005-4f89-9a35-bb6b4062d756 req-772a20c3-e0f6-488a-9055-f91687dff3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee319d6b-f1f1-4aa0-87f9-a7968127f8fb", "name": "network-vif-plugged", "status": "completed", "tag": "6b5b82bb-9720-45e8-b150-c8e10e1ded24"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:24:10.154265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-1e301243-b005-4f89-9a35-bb6b4062d756 req-772a20c3-e0f6-488a-9055-f91687dff3e4 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:10.156101 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-1e301243-b005-4f89-9a35-bb6b4062d756 req-772a20c3-e0f6-488a-9055-f91687dff3e4 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:10.165571 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-1e301243-b005-4f89-9a35-bb6b4062d756 req-772a20c3-e0f6-488a-9055-f91687dff3e4 service nova] Creating event network-vif-plugged:6b5b82bb-9720-45e8-b150-c8e10e1ded24 for instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb on hv-cinder-84213 May 26 20:24:10.171490 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-1e301243-b005-4f89-9a35-bb6b4062d756 req-772a20c3-e0f6-488a-9055-f91687dff3e4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090105 May 26 20:24:10.172448 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 52/107] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:24:10.182786 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0596b3db-5c92-48cf-b72d-d28350b75ae2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:10.188477 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0596b3db-5c92-48cf-b72d-d28350b75ae2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:10.201337 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0596b3db-5c92-48cf-b72d-d28350b75ae2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:10.202534 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0596b3db-5c92-48cf-b72d-d28350b75ae2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:10.205456 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0596b3db-5c92-48cf-b72d-d28350b75ae2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:10.210192 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0596b3db-5c92-48cf-b72d-d28350b75ae2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:10.240911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=100 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:10.400437 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-0596b3db-5c92-48cf-b72d-d28350b75ae2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:10.412282 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0596b3db-5c92-48cf-b72d-d28350b75ae2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.234233 May 26 20:24:10.414570 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 56/108] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:10 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:10.579645 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0e717c9a-9afd-47e8-b478-2802cec14885 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:10.579645 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0e717c9a-9afd-47e8-b478-2802cec14885 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:10.585766 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e717c9a-9afd-47e8-b478-2802cec14885 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:10.586456 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e717c9a-9afd-47e8-b478-2802cec14885 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:10.587575 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e717c9a-9afd-47e8-b478-2802cec14885 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:10.588224 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e717c9a-9afd-47e8-b478-2802cec14885 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:10.796703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-0e717c9a-9afd-47e8-b478-2802cec14885 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:10.811100 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0e717c9a-9afd-47e8-b478-2802cec14885 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.242910 May 26 20:24:10.816359 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 53/109] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:10 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:11.053913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5396a5a6-6e87-41e3-94e3-5b12d89349e3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:11.055515 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5396a5a6-6e87-41e3-94e3-5b12d89349e3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:11.070321 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5396a5a6-6e87-41e3-94e3-5b12d89349e3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:11.070889 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5396a5a6-6e87-41e3-94e3-5b12d89349e3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:11.072055 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5396a5a6-6e87-41e3-94e3-5b12d89349e3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:11.075076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5396a5a6-6e87-41e3-94e3-5b12d89349e3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:11.270096 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5396a5a6-6e87-41e3-94e3-5b12d89349e3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:11.278789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5396a5a6-6e87-41e3-94e3-5b12d89349e3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.238109 May 26 20:24:11.288708 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 57/110] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:11 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:11.429515 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-80bf7f3e-1524-40d4-a2b2-361423f5ded8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:11.430133 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-80bf7f3e-1524-40d4-a2b2-361423f5ded8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:11.437266 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80bf7f3e-1524-40d4-a2b2-361423f5ded8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:11.437708 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80bf7f3e-1524-40d4-a2b2-361423f5ded8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:11.438800 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80bf7f3e-1524-40d4-a2b2-361423f5ded8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:11.439480 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80bf7f3e-1524-40d4-a2b2-361423f5ded8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:11.599961 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-80bf7f3e-1524-40d4-a2b2-361423f5ded8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:11.617232 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-80bf7f3e-1524-40d4-a2b2-361423f5ded8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.190006 May 26 20:24:11.618782 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 54/111] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:11 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:11.832967 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-189e4cc4-829a-40b6-9d7f-ba56b799f89a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:11.833740 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-189e4cc4-829a-40b6-9d7f-ba56b799f89a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:11.840528 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-189e4cc4-829a-40b6-9d7f-ba56b799f89a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:11.841157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-189e4cc4-829a-40b6-9d7f-ba56b799f89a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:11.842103 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-189e4cc4-829a-40b6-9d7f-ba56b799f89a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:11.843053 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-189e4cc4-829a-40b6-9d7f-ba56b799f89a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:11.998145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-189e4cc4-829a-40b6-9d7f-ba56b799f89a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:12.010187 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-189e4cc4-829a-40b6-9d7f-ba56b799f89a tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1315 microversion: 2.1 time: 0.180654 May 26 20:24:12.011878 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 58/112] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:11 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:12.198156 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-14a96092-1ddd-46c5-97e0-d2df5387b6d3 req-f24638b5-f63f-49c3-980f-f6927dffbcfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b0640b-f71f-43b5-b9c6-bac52df82796", "name": "network-vif-plugged", "status": "completed", "tag": "f7c54df1-d39f-4aff-83be-3bcd00c8c9cd"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:24:12.207379 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-14a96092-1ddd-46c5-97e0-d2df5387b6d3 req-f24638b5-f63f-49c3-980f-f6927dffbcfb service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:12.208053 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-14a96092-1ddd-46c5-97e0-d2df5387b6d3 req-f24638b5-f63f-49c3-980f-f6927dffbcfb service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:12.222508 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-14a96092-1ddd-46c5-97e0-d2df5387b6d3 req-f24638b5-f63f-49c3-980f-f6927dffbcfb service nova] Creating event network-vif-plugged:f7c54df1-d39f-4aff-83be-3bcd00c8c9cd for instance 50b0640b-f71f-43b5-b9c6-bac52df82796 on hv-cinder-84213 May 26 20:24:12.230683 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-14a96092-1ddd-46c5-97e0-d2df5387b6d3 req-f24638b5-f63f-49c3-980f-f6927dffbcfb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036186 May 26 20:24:12.231489 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 55/113] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:24:12.296449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-aa60b1bf-4e01-459a-81c1-05abcd3f5694 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:12.298988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-aa60b1bf-4e01-459a-81c1-05abcd3f5694 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:12.307878 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-aa60b1bf-4e01-459a-81c1-05abcd3f5694 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:12.309345 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-aa60b1bf-4e01-459a-81c1-05abcd3f5694 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:12.310180 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-aa60b1bf-4e01-459a-81c1-05abcd3f5694 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:12.310641 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-aa60b1bf-4e01-459a-81c1-05abcd3f5694 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:12.464957 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-aa60b1bf-4e01-459a-81c1-05abcd3f5694 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:12.472788 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-aa60b1bf-4e01-459a-81c1-05abcd3f5694 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.181227 May 26 20:24:12.473365 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 59/114] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:12 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:12.634860 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-26fffa1c-c5cd-4790-90a3-13213f2be434 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:12.635648 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-26fffa1c-c5cd-4790-90a3-13213f2be434 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:12.646067 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-26fffa1c-c5cd-4790-90a3-13213f2be434 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:12.647332 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-26fffa1c-c5cd-4790-90a3-13213f2be434 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:12.648155 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-26fffa1c-c5cd-4790-90a3-13213f2be434 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:12.648592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-26fffa1c-c5cd-4790-90a3-13213f2be434 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:12.843816 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-26fffa1c-c5cd-4790-90a3-13213f2be434 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:12.852835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-26fffa1c-c5cd-4790-90a3-13213f2be434 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.222579 May 26 20:24:12.866929 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 56/115] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:12 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:13.029207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-74eac328-18d4-466c-9df7-2c005071b663 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:13.029842 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-74eac328-18d4-466c-9df7-2c005071b663 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:13.036918 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-74eac328-18d4-466c-9df7-2c005071b663 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:13.037365 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-74eac328-18d4-466c-9df7-2c005071b663 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:13.038127 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-74eac328-18d4-466c-9df7-2c005071b663 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:13.038578 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-74eac328-18d4-466c-9df7-2c005071b663 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:13.196843 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-74eac328-18d4-466c-9df7-2c005071b663 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:13.206273 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-74eac328-18d4-466c-9df7-2c005071b663 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1502 microversion: 2.1 time: 0.181594 May 26 20:24:13.215826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 60/116] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:13 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:13.490876 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cfa3c224-1400-47a5-aba5-eabd73a6655d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:13.491645 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cfa3c224-1400-47a5-aba5-eabd73a6655d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:13.498767 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cfa3c224-1400-47a5-aba5-eabd73a6655d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:13.499208 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cfa3c224-1400-47a5-aba5-eabd73a6655d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:13.500133 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cfa3c224-1400-47a5-aba5-eabd73a6655d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:13.500842 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cfa3c224-1400-47a5-aba5-eabd73a6655d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:13.518708 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:13.689193 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cfa3c224-1400-47a5-aba5-eabd73a6655d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:13.698613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cfa3c224-1400-47a5-aba5-eabd73a6655d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.212188 May 26 20:24:13.699248 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 57/117] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:13 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:13.871969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4b8392e7-c466-4cc6-9390-301e6ed97b27 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:13.872580 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4b8392e7-c466-4cc6-9390-301e6ed97b27 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:13.878617 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4b8392e7-c466-4cc6-9390-301e6ed97b27 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:13.879060 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4b8392e7-c466-4cc6-9390-301e6ed97b27 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:13.880009 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4b8392e7-c466-4cc6-9390-301e6ed97b27 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:13.880439 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4b8392e7-c466-4cc6-9390-301e6ed97b27 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:14.018422 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4b8392e7-c466-4cc6-9390-301e6ed97b27 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:14.030434 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4b8392e7-c466-4cc6-9390-301e6ed97b27 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.158482 May 26 20:24:14.030434 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 61/118] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:13 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:14.303904 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-0542265c-b9e7-403e-86a4-759d70488bc6 req-ac06a1d4-661d-4fa5-a2d2-b7c346ce851a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f23bb01-825e-4dcf-a2a0-e75b6c8928ab", "name": "network-vif-plugged", "status": "completed", "tag": "fd4a262c-5c5f-4b05-ac17-c0c6aed612e9"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:24:14.317718 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-0542265c-b9e7-403e-86a4-759d70488bc6 req-ac06a1d4-661d-4fa5-a2d2-b7c346ce851a service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:14.317718 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-0542265c-b9e7-403e-86a4-759d70488bc6 req-ac06a1d4-661d-4fa5-a2d2-b7c346ce851a service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:14.330160 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-0542265c-b9e7-403e-86a4-759d70488bc6 req-ac06a1d4-661d-4fa5-a2d2-b7c346ce851a service nova] Creating event network-vif-plugged:fd4a262c-5c5f-4b05-ac17-c0c6aed612e9 for instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab on hv-cinder-84213 May 26 20:24:14.336928 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-0542265c-b9e7-403e-86a4-759d70488bc6 req-ac06a1d4-661d-4fa5-a2d2-b7c346ce851a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049638 May 26 20:24:14.337776 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 58/119] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:24:14.716301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6e6b0e73-c22a-43b5-a2d3-b2e8cd954300 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:14.717438 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6e6b0e73-c22a-43b5-a2d3-b2e8cd954300 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:14.725017 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6e6b0e73-c22a-43b5-a2d3-b2e8cd954300 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:14.728169 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6e6b0e73-c22a-43b5-a2d3-b2e8cd954300 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:14.737590 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6e6b0e73-c22a-43b5-a2d3-b2e8cd954300 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:14.737590 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6e6b0e73-c22a-43b5-a2d3-b2e8cd954300 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:14.884662 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6e6b0e73-c22a-43b5-a2d3-b2e8cd954300 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:14.892881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6e6b0e73-c22a-43b5-a2d3-b2e8cd954300 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1322 microversion: 2.1 time: 0.180719 May 26 20:24:14.893666 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 62/120] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:14 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:15.045473 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4eb5279a-90c6-4c0f-9d9b-874424337105 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:15.046393 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4eb5279a-90c6-4c0f-9d9b-874424337105 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:15.052731 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4eb5279a-90c6-4c0f-9d9b-874424337105 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:15.053175 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4eb5279a-90c6-4c0f-9d9b-874424337105 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:15.053943 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4eb5279a-90c6-4c0f-9d9b-874424337105 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:15.054476 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4eb5279a-90c6-4c0f-9d9b-874424337105 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:15.207575 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-4eb5279a-90c6-4c0f-9d9b-874424337105 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:15.215464 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4eb5279a-90c6-4c0f-9d9b-874424337105 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.174865 May 26 20:24:15.225584 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 59/121] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:15 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:15.531350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-dd6ccf6e-0590-47cf-9ba5-0c23d0c07af0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "500de94e-f273-48e8-9d08-c5618d459972"}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:24:15.531545 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-dd6ccf6e-0590-47cf-9ba5-0c23d0c07af0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:15.538837 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dd6ccf6e-0590-47cf-9ba5-0c23d0c07af0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:15.539501 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dd6ccf6e-0590-47cf-9ba5-0c23d0c07af0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:15.540381 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dd6ccf6e-0590-47cf-9ba5-0c23d0c07af0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:15.540921 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dd6ccf6e-0590-47cf-9ba5-0c23d0c07af0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:15.912170 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-485a8e7d-a802-43ae-b788-1614067155f9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:15.913146 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-485a8e7d-a802-43ae-b788-1614067155f9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:15.922223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-485a8e7d-a802-43ae-b788-1614067155f9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:15.923450 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-485a8e7d-a802-43ae-b788-1614067155f9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:15.923788 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-485a8e7d-a802-43ae-b788-1614067155f9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:15.924232 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-485a8e7d-a802-43ae-b788-1614067155f9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:16.074267 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-485a8e7d-a802-43ae-b788-1614067155f9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:16.082529 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-485a8e7d-a802-43ae-b788-1614067155f9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1515 microversion: 2.1 time: 0.175187 May 26 20:24:16.083232 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 60/122] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:15 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:24:16.100317 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-719dd816-1213-4ba4-bf67-0f3b06bd2127 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:24:16.101268 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-719dd816-1213-4ba4-bf67-0f3b06bd2127 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:16.108444 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-719dd816-1213-4ba4-bf67-0f3b06bd2127 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:16.108901 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-719dd816-1213-4ba4-bf67-0f3b06bd2127 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:16.109775 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-719dd816-1213-4ba4-bf67-0f3b06bd2127 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:16.110217 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-719dd816-1213-4ba4-bf67-0f3b06bd2127 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:16.180008 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-719dd816-1213-4ba4-bf67-0f3b06bd2127 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lazy-loading 'flavor' on Instance uuid 50b0640b-f71f-43b5-b9c6-bac52df82796 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:24:16.837349 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-dd6ccf6e-0590-47cf-9ba5-0c23d0c07af0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "POST /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.310939 May 26 20:24:16.841138 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 63/123] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:24:15 2022] POST /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb/os-volume_attachments => generated 194 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:24:16.852784 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-dd335f1f-0a4e-4c6c-ba72-07b38da5ca1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:16.856448 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-dd335f1f-0a4e-4c6c-ba72-07b38da5ca1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:16.864743 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dd335f1f-0a4e-4c6c-ba72-07b38da5ca1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:16.865388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dd335f1f-0a4e-4c6c-ba72-07b38da5ca1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:16.866162 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dd335f1f-0a4e-4c6c-ba72-07b38da5ca1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:16.866734 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dd335f1f-0a4e-4c6c-ba72-07b38da5ca1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:16.965771 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-719dd816-1213-4ba4-bf67-0f3b06bd2127 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "POST /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796/action" status: 200 len: 32 microversion: 2.1 time: 0.867203 May 26 20:24:16.965771 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 61/124] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:24:16 2022] POST /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796/action => generated 32 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 20:24:16.971999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-e6c007a5-e12e-4282-a2f1-93348425eb91 req-b4cb5846-affb-4589-9398-6153d28ab348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f", "name": "network-vif-plugged", "status": "completed", "tag": "ed56f181-3869-4093-b872-aca46d220d93"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:24:16.983882 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e6c007a5-e12e-4282-a2f1-93348425eb91 req-b4cb5846-affb-4589-9398-6153d28ab348 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:16.984339 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e6c007a5-e12e-4282-a2f1-93348425eb91 req-b4cb5846-affb-4589-9398-6153d28ab348 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:16.999804 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-e6c007a5-e12e-4282-a2f1-93348425eb91 req-b4cb5846-affb-4589-9398-6153d28ab348 service nova] Creating event network-vif-plugged:ed56f181-3869-4093-b872-aca46d220d93 for instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f on hv-cinder-84213 May 26 20:24:17.005046 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-e6c007a5-e12e-4282-a2f1-93348425eb91 req-b4cb5846-affb-4589-9398-6153d28ab348 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039473 May 26 20:24:17.005854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 62/125] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:24:17.015245 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e4da11eb-8ca3-404f-8c6f-3a46cb670b21 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:17.016300 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e4da11eb-8ca3-404f-8c6f-3a46cb670b21 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:17.023533 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4da11eb-8ca3-404f-8c6f-3a46cb670b21 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:17.024257 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4da11eb-8ca3-404f-8c6f-3a46cb670b21 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:17.025195 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4da11eb-8ca3-404f-8c6f-3a46cb670b21 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:17.025791 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4da11eb-8ca3-404f-8c6f-3a46cb670b21 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:17.115225 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-dd335f1f-0a4e-4c6c-ba72-07b38da5ca1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:17.123909 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-dd335f1f-0a4e-4c6c-ba72-07b38da5ca1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.283821 May 26 20:24:17.131742 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 64/126] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:16 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:17.371419 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e4da11eb-8ca3-404f-8c6f-3a46cb670b21 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:17.385718 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e4da11eb-8ca3-404f-8c6f-3a46cb670b21 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.375585 May 26 20:24:17.396559 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 63/127] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:17 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:18.148518 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-61096d50-5f79-44ba-8fff-99dbe4660667 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:18.149132 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-61096d50-5f79-44ba-8fff-99dbe4660667 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:18.157255 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61096d50-5f79-44ba-8fff-99dbe4660667 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:18.157711 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61096d50-5f79-44ba-8fff-99dbe4660667 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:18.158515 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61096d50-5f79-44ba-8fff-99dbe4660667 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:18.159124 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61096d50-5f79-44ba-8fff-99dbe4660667 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:18.342650 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-61096d50-5f79-44ba-8fff-99dbe4660667 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:18.353307 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-61096d50-5f79-44ba-8fff-99dbe4660667 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.208752 May 26 20:24:18.354663 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 65/128] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:18 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:18.404496 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4c51c2c6-6470-4a23-8c94-4044f16e65d0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:18.405228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4c51c2c6-6470-4a23-8c94-4044f16e65d0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:18.411838 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4c51c2c6-6470-4a23-8c94-4044f16e65d0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:18.412657 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4c51c2c6-6470-4a23-8c94-4044f16e65d0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:18.413442 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4c51c2c6-6470-4a23-8c94-4044f16e65d0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:18.413880 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4c51c2c6-6470-4a23-8c94-4044f16e65d0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:18.610012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-4c51c2c6-6470-4a23-8c94-4044f16e65d0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:18.619047 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4c51c2c6-6470-4a23-8c94-4044f16e65d0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.219132 May 26 20:24:18.624692 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 64/129] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:18 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:19.377749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-67cf8cc0-de2e-446d-a4ad-734f5cbcbf3e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:19.378414 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-67cf8cc0-de2e-446d-a4ad-734f5cbcbf3e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:19.385518 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-67cf8cc0-de2e-446d-a4ad-734f5cbcbf3e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:19.387136 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-67cf8cc0-de2e-446d-a4ad-734f5cbcbf3e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:19.388383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-67cf8cc0-de2e-446d-a4ad-734f5cbcbf3e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:19.389586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-67cf8cc0-de2e-446d-a4ad-734f5cbcbf3e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:19.566483 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-67cf8cc0-de2e-446d-a4ad-734f5cbcbf3e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:19.575602 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-67cf8cc0-de2e-446d-a4ad-734f5cbcbf3e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.202012 May 26 20:24:19.576184 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 66/130] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:19 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:19.637660 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c7ec5abd-c957-4f54-9598-5d4e246b3dff tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:19.638502 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c7ec5abd-c957-4f54-9598-5d4e246b3dff tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:19.645545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c7ec5abd-c957-4f54-9598-5d4e246b3dff tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:19.646585 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c7ec5abd-c957-4f54-9598-5d4e246b3dff tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:19.647598 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c7ec5abd-c957-4f54-9598-5d4e246b3dff tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:19.648260 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c7ec5abd-c957-4f54-9598-5d4e246b3dff tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:19.813329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c7ec5abd-c957-4f54-9598-5d4e246b3dff tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:19.821610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c7ec5abd-c957-4f54-9598-5d4e246b3dff tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.188596 May 26 20:24:19.822426 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 65/131] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:19 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:20.592285 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-37243821-a815-4636-954f-a0cca7a50e82 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:20.593164 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-37243821-a815-4636-954f-a0cca7a50e82 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:20.599922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-37243821-a815-4636-954f-a0cca7a50e82 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:20.605649 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-37243821-a815-4636-954f-a0cca7a50e82 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:20.605649 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-37243821-a815-4636-954f-a0cca7a50e82 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:20.605649 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-37243821-a815-4636-954f-a0cca7a50e82 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:20.759500 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-37243821-a815-4636-954f-a0cca7a50e82 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:20.767281 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-37243821-a815-4636-954f-a0cca7a50e82 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1548 microversion: 2.1 time: 0.179526 May 26 20:24:20.767841 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 67/132] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:20 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1548 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:20.784546 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7399e67d-ef8a-4bfa-9379-bae421231013 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:20.785061 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7399e67d-ef8a-4bfa-9379-bae421231013 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:20.791284 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7399e67d-ef8a-4bfa-9379-bae421231013 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:20.791727 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7399e67d-ef8a-4bfa-9379-bae421231013 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:20.793059 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7399e67d-ef8a-4bfa-9379-bae421231013 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:20.793591 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7399e67d-ef8a-4bfa-9379-bae421231013 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:20.843778 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-838764a4-8bac-4912-ac35-acc9c4f620f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:20.844642 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-838764a4-8bac-4912-ac35-acc9c4f620f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:20.852809 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-838764a4-8bac-4912-ac35-acc9c4f620f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:20.853613 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-838764a4-8bac-4912-ac35-acc9c4f620f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:20.855420 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-838764a4-8bac-4912-ac35-acc9c4f620f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:20.856365 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-838764a4-8bac-4912-ac35-acc9c4f620f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:20.922564 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7399e67d-ef8a-4bfa-9379-bae421231013 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141774 May 26 20:24:20.927402 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 66/133] 10.222.0.44 () {58 vars in 1274 bytes} [Thu May 26 20:24:20 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:24:21.032745 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-838764a4-8bac-4912-ac35-acc9c4f620f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:21.043952 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-838764a4-8bac-4912-ac35-acc9c4f620f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.205539 May 26 20:24:21.044722 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 68/134] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:20 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:22.063475 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-25465ea4-e184-46bd-89b1-b428363cf4e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:22.064382 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-25465ea4-e184-46bd-89b1-b428363cf4e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:22.071159 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25465ea4-e184-46bd-89b1-b428363cf4e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:22.071806 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25465ea4-e184-46bd-89b1-b428363cf4e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:22.073188 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25465ea4-e184-46bd-89b1-b428363cf4e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:22.074334 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25465ea4-e184-46bd-89b1-b428363cf4e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:22.497882 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-25465ea4-e184-46bd-89b1-b428363cf4e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:22.505447 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-25465ea4-e184-46bd-89b1-b428363cf4e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.446812 May 26 20:24:22.506019 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 67/135] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:22 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:22.663482 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-333deac5-4797-4500-b0d3-739f36be5000 req-708e6e6f-d3ec-42c1-b282-897805c5ad92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f", "tag": "ed56f181-3869-4093-b872-aca46d220d93"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:24:22.674590 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-333deac5-4797-4500-b0d3-739f36be5000 req-708e6e6f-d3ec-42c1-b282-897805c5ad92 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:22.675301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-333deac5-4797-4500-b0d3-739f36be5000 req-708e6e6f-d3ec-42c1-b282-897805c5ad92 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:22.689589 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-333deac5-4797-4500-b0d3-739f36be5000 req-708e6e6f-d3ec-42c1-b282-897805c5ad92 service nova] Creating event network-changed:ed56f181-3869-4093-b872-aca46d220d93 for instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f on hv-cinder-84213 May 26 20:24:22.696845 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-333deac5-4797-4500-b0d3-739f36be5000 req-708e6e6f-d3ec-42c1-b282-897805c5ad92 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037412 May 26 20:24:22.702467 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 69/136] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:24:23.525812 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-09417bea-ffb5-4530-8962-b81c2371356e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:23.527383 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-09417bea-ffb5-4530-8962-b81c2371356e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:23.537164 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09417bea-ffb5-4530-8962-b81c2371356e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:23.537900 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09417bea-ffb5-4530-8962-b81c2371356e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:23.538774 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09417bea-ffb5-4530-8962-b81c2371356e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:23.539463 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09417bea-ffb5-4530-8962-b81c2371356e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:23.690482 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-09417bea-ffb5-4530-8962-b81c2371356e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:23.702481 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-09417bea-ffb5-4530-8962-b81c2371356e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.178961 May 26 20:24:23.703337 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 68/137] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:23 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:24.720987 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4dcac542-00c9-4c9a-901e-00130ed529a0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:24.721682 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4dcac542-00c9-4c9a-901e-00130ed529a0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:24.728208 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4dcac542-00c9-4c9a-901e-00130ed529a0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:24.728663 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4dcac542-00c9-4c9a-901e-00130ed529a0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:24.729398 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4dcac542-00c9-4c9a-901e-00130ed529a0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:24.730027 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4dcac542-00c9-4c9a-901e-00130ed529a0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:24.868329 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4dcac542-00c9-4c9a-901e-00130ed529a0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:24.876321 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4dcac542-00c9-4c9a-901e-00130ed529a0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.160260 May 26 20:24:24.876929 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 70/138] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:24 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:25.893401 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8c813841-ed10-4f80-8eed-f2962d927435 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:25.894051 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8c813841-ed10-4f80-8eed-f2962d927435 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:25.900152 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8c813841-ed10-4f80-8eed-f2962d927435 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:25.900596 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8c813841-ed10-4f80-8eed-f2962d927435 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:25.901478 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8c813841-ed10-4f80-8eed-f2962d927435 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:25.901908 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8c813841-ed10-4f80-8eed-f2962d927435 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:26.038633 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-8c813841-ed10-4f80-8eed-f2962d927435 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:26.047167 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8c813841-ed10-4f80-8eed-f2962d927435 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.157764 May 26 20:24:26.047831 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 69/139] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:25 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:24:27.064261 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ff30c325-18d0-4262-9955-6d8e27cd272d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:27.064873 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ff30c325-18d0-4262-9955-6d8e27cd272d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:27.071724 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ff30c325-18d0-4262-9955-6d8e27cd272d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:27.072202 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ff30c325-18d0-4262-9955-6d8e27cd272d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:27.073152 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ff30c325-18d0-4262-9955-6d8e27cd272d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:27.074123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ff30c325-18d0-4262-9955-6d8e27cd272d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:27.204000 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ff30c325-18d0-4262-9955-6d8e27cd272d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:27.211554 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ff30c325-18d0-4262-9955-6d8e27cd272d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.151198 May 26 20:24:27.212116 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 71/140] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:27 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:28.228257 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-81edb76f-0f1a-4d2a-bb4d-e8ee56179f76 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:28.228859 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-81edb76f-0f1a-4d2a-bb4d-e8ee56179f76 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:28.234906 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-81edb76f-0f1a-4d2a-bb4d-e8ee56179f76 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:28.235344 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-81edb76f-0f1a-4d2a-bb4d-e8ee56179f76 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:28.236088 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-81edb76f-0f1a-4d2a-bb4d-e8ee56179f76 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:28.236515 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-81edb76f-0f1a-4d2a-bb4d-e8ee56179f76 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:28.364137 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-81edb76f-0f1a-4d2a-bb4d-e8ee56179f76 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:28.371757 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-81edb76f-0f1a-4d2a-bb4d-e8ee56179f76 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.147434 May 26 20:24:28.372320 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 70/141] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:28 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:29.493394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9e43f7e3-12fc-427f-83b9-4db9698596c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:29.493394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9e43f7e3-12fc-427f-83b9-4db9698596c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:29.493394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9e43f7e3-12fc-427f-83b9-4db9698596c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:29.493394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9e43f7e3-12fc-427f-83b9-4db9698596c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:29.495587 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9e43f7e3-12fc-427f-83b9-4db9698596c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:29.495587 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9e43f7e3-12fc-427f-83b9-4db9698596c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:29.495587 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:29.531192 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9e43f7e3-12fc-427f-83b9-4db9698596c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:29.544619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9e43f7e3-12fc-427f-83b9-4db9698596c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.153930 May 26 20:24:29.544619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 72/142] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:29 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:30.554790 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-97e9542b-6f54-4d5d-bd9d-eeda74022490 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:30.555322 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-97e9542b-6f54-4d5d-bd9d-eeda74022490 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:30.561417 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e9542b-6f54-4d5d-bd9d-eeda74022490 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:30.561860 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e9542b-6f54-4d5d-bd9d-eeda74022490 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:30.562639 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e9542b-6f54-4d5d-bd9d-eeda74022490 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:30.563074 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e9542b-6f54-4d5d-bd9d-eeda74022490 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:30.691094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-97e9542b-6f54-4d5d-bd9d-eeda74022490 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:30.698938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-97e9542b-6f54-4d5d-bd9d-eeda74022490 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.148014 May 26 20:24:30.700094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 71/143] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:30 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:31.716434 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-372f94f1-8d04-4b9d-9540-cd8cee5c046c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:31.717040 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-372f94f1-8d04-4b9d-9540-cd8cee5c046c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:31.720048 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=67 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:31.725940 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-372f94f1-8d04-4b9d-9540-cd8cee5c046c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:31.726424 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-372f94f1-8d04-4b9d-9540-cd8cee5c046c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:31.727189 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-372f94f1-8d04-4b9d-9540-cd8cee5c046c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:31.727623 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-372f94f1-8d04-4b9d-9540-cd8cee5c046c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:31.861335 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-372f94f1-8d04-4b9d-9540-cd8cee5c046c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:31.868972 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-372f94f1-8d04-4b9d-9540-cd8cee5c046c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.156592 May 26 20:24:31.872954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 73/144] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:31 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:32.887078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-303ec6fa-f185-4de4-8155-837e46f01cf3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:32.888502 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-303ec6fa-f185-4de4-8155-837e46f01cf3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:32.890831 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=66 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:32.896082 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-303ec6fa-f185-4de4-8155-837e46f01cf3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:32.896601 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-303ec6fa-f185-4de4-8155-837e46f01cf3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:32.897365 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-303ec6fa-f185-4de4-8155-837e46f01cf3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:32.897970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-303ec6fa-f185-4de4-8155-837e46f01cf3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:33.040256 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-303ec6fa-f185-4de4-8155-837e46f01cf3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:33.048231 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-303ec6fa-f185-4de4-8155-837e46f01cf3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.165111 May 26 20:24:33.048795 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 72/145] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:32 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:34.065462 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-22b40150-f9fe-4c32-b158-7146e75b2a79 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:34.066001 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-22b40150-f9fe-4c32-b158-7146e75b2a79 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:34.072996 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-22b40150-f9fe-4c32-b158-7146e75b2a79 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:34.073441 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-22b40150-f9fe-4c32-b158-7146e75b2a79 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:34.074187 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-22b40150-f9fe-4c32-b158-7146e75b2a79 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:34.074641 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-22b40150-f9fe-4c32-b158-7146e75b2a79 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:34.207843 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-22b40150-f9fe-4c32-b158-7146e75b2a79 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:34.215416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-22b40150-f9fe-4c32-b158-7146e75b2a79 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.153843 May 26 20:24:34.216707 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 74/146] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:34 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:35.233790 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6c623a69-7450-43cb-a0a7-4074fc1145a6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:35.234562 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6c623a69-7450-43cb-a0a7-4074fc1145a6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:35.240896 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c623a69-7450-43cb-a0a7-4074fc1145a6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:35.241428 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c623a69-7450-43cb-a0a7-4074fc1145a6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:35.242344 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c623a69-7450-43cb-a0a7-4074fc1145a6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:35.242830 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c623a69-7450-43cb-a0a7-4074fc1145a6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:35.376447 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6c623a69-7450-43cb-a0a7-4074fc1145a6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:35.378689 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:35.384469 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6c623a69-7450-43cb-a0a7-4074fc1145a6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.155466 May 26 20:24:35.385039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 73/147] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:35 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:36.402449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-75ff7814-e4ff-4e44-8855-e9acf484dffc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:36.403160 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-75ff7814-e4ff-4e44-8855-e9acf484dffc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:36.410465 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75ff7814-e4ff-4e44-8855-e9acf484dffc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:36.411914 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75ff7814-e4ff-4e44-8855-e9acf484dffc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:36.412839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75ff7814-e4ff-4e44-8855-e9acf484dffc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:36.413349 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75ff7814-e4ff-4e44-8855-e9acf484dffc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:36.556070 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-75ff7814-e4ff-4e44-8855-e9acf484dffc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:36.563003 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-75ff7814-e4ff-4e44-8855-e9acf484dffc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.164553 May 26 20:24:36.563575 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 75/148] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:36 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:37.580677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7fc5e2c9-2e32-405b-942a-1bec15a1068e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:37.581249 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7fc5e2c9-2e32-405b-942a-1bec15a1068e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:37.587629 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fc5e2c9-2e32-405b-942a-1bec15a1068e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:37.588173 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fc5e2c9-2e32-405b-942a-1bec15a1068e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:37.588923 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fc5e2c9-2e32-405b-942a-1bec15a1068e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:37.589409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7fc5e2c9-2e32-405b-942a-1bec15a1068e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:37.717755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7fc5e2c9-2e32-405b-942a-1bec15a1068e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:37.725325 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7fc5e2c9-2e32-405b-942a-1bec15a1068e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.149465 May 26 20:24:37.725901 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 74/149] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:37 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:38.744218 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-08cb62a8-3148-44f1-869f-2549006f08cd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:38.744836 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-08cb62a8-3148-44f1-869f-2549006f08cd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:38.748209 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cab263ef-3f91-4a40-a9c2-83af5a51d569 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:38.749058 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cab263ef-3f91-4a40-a9c2-83af5a51d569 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:38.751696 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-08cb62a8-3148-44f1-869f-2549006f08cd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:38.752378 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-08cb62a8-3148-44f1-869f-2549006f08cd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:38.753166 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-08cb62a8-3148-44f1-869f-2549006f08cd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:38.754832 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-08cb62a8-3148-44f1-869f-2549006f08cd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:38.757821 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cab263ef-3f91-4a40-a9c2-83af5a51d569 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:38.761618 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cab263ef-3f91-4a40-a9c2-83af5a51d569 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:38.761618 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cab263ef-3f91-4a40-a9c2-83af5a51d569 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:38.761618 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cab263ef-3f91-4a40-a9c2-83af5a51d569 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:38.786907 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cab263ef-3f91-4a40-a9c2-83af5a51d569 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:24:38.904325 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-08cb62a8-3148-44f1-869f-2549006f08cd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:38.914939 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-08cb62a8-3148-44f1-869f-2549006f08cd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.174628 May 26 20:24:38.915581 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 76/150] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:38 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:39.087786 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cab263ef-3f91-4a40-a9c2-83af5a51d569 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 204 len: 0 microversion: 2.1 time: 0.343673 May 26 20:24:39.088388 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 75/151] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:24:38 2022] DELETE /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:24:39.097161 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c3f57267-ccb3-4d1e-845f-4c59abaeba02 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:39.097777 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c3f57267-ccb3-4d1e-845f-4c59abaeba02 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:39.104135 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c3f57267-ccb3-4d1e-845f-4c59abaeba02 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:39.104585 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c3f57267-ccb3-4d1e-845f-4c59abaeba02 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:39.105347 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c3f57267-ccb3-4d1e-845f-4c59abaeba02 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:39.105792 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c3f57267-ccb3-4d1e-845f-4c59abaeba02 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:39.238542 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c3f57267-ccb3-4d1e-845f-4c59abaeba02 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:39.246492 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c3f57267-ccb3-4d1e-845f-4c59abaeba02 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1554 microversion: 2.1 time: 0.153202 May 26 20:24:39.247117 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 77/152] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:39 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:24:39.932080 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a9bb0d2e-dc10-4110-9515-a70a96fd4198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:39.932795 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a9bb0d2e-dc10-4110-9515-a70a96fd4198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:39.938892 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a9bb0d2e-dc10-4110-9515-a70a96fd4198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:39.939335 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a9bb0d2e-dc10-4110-9515-a70a96fd4198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:39.940121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a9bb0d2e-dc10-4110-9515-a70a96fd4198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:39.940551 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a9bb0d2e-dc10-4110-9515-a70a96fd4198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:40.073325 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a9bb0d2e-dc10-4110-9515-a70a96fd4198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:40.081018 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a9bb0d2e-dc10-4110-9515-a70a96fd4198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.153447 May 26 20:24:40.081587 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 76/153] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:39 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:40.264897 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e7a61df7-896e-4f0c-a74e-90859a2ea2f7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:40.265539 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e7a61df7-896e-4f0c-a74e-90859a2ea2f7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:40.272084 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e7a61df7-896e-4f0c-a74e-90859a2ea2f7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:40.272567 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e7a61df7-896e-4f0c-a74e-90859a2ea2f7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:40.273329 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e7a61df7-896e-4f0c-a74e-90859a2ea2f7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:40.273763 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e7a61df7-896e-4f0c-a74e-90859a2ea2f7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:40.398464 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e7a61df7-896e-4f0c-a74e-90859a2ea2f7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:40.407041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e7a61df7-896e-4f0c-a74e-90859a2ea2f7 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1554 microversion: 2.1 time: 0.146642 May 26 20:24:40.407603 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 78/154] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:40 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:41.098152 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eb386f9e-61ab-47d6-81c1-4f7b4d284670 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:41.098795 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eb386f9e-61ab-47d6-81c1-4f7b4d284670 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:41.104989 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb386f9e-61ab-47d6-81c1-4f7b4d284670 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:41.105415 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb386f9e-61ab-47d6-81c1-4f7b4d284670 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:41.106193 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb386f9e-61ab-47d6-81c1-4f7b4d284670 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:41.106698 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb386f9e-61ab-47d6-81c1-4f7b4d284670 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:41.229966 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-eb386f9e-61ab-47d6-81c1-4f7b4d284670 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:41.237857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eb386f9e-61ab-47d6-81c1-4f7b4d284670 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.143507 May 26 20:24:41.238442 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 77/155] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:41 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:41.424300 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-d34fa5fd-b9fb-4cfc-b049-50e61704ccd0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:41.424906 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-d34fa5fd-b9fb-4cfc-b049-50e61704ccd0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:41.431358 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d34fa5fd-b9fb-4cfc-b049-50e61704ccd0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:41.431796 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d34fa5fd-b9fb-4cfc-b049-50e61704ccd0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:41.432549 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d34fa5fd-b9fb-4cfc-b049-50e61704ccd0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:41.432971 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d34fa5fd-b9fb-4cfc-b049-50e61704ccd0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:41.569569 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-d34fa5fd-b9fb-4cfc-b049-50e61704ccd0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:41.579244 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-d34fa5fd-b9fb-4cfc-b049-50e61704ccd0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1554 microversion: 2.1 time: 0.159292 May 26 20:24:41.591360 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 79/156] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:41 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:42.254566 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-53c9b7c5-2557-447e-a869-12b192daad03 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:42.255159 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-53c9b7c5-2557-447e-a869-12b192daad03 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:42.261197 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-53c9b7c5-2557-447e-a869-12b192daad03 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:42.261579 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-53c9b7c5-2557-447e-a869-12b192daad03 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:42.262374 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-53c9b7c5-2557-447e-a869-12b192daad03 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:42.262827 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-53c9b7c5-2557-447e-a869-12b192daad03 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:42.392905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-53c9b7c5-2557-447e-a869-12b192daad03 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:42.400297 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-53c9b7c5-2557-447e-a869-12b192daad03 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.149723 May 26 20:24:42.400884 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 78/157] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:42 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:42.598169 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4260b250-de22-43bc-a6e2-dcba17c22efd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:42.598807 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4260b250-de22-43bc-a6e2-dcba17c22efd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:42.605349 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4260b250-de22-43bc-a6e2-dcba17c22efd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:42.607344 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4260b250-de22-43bc-a6e2-dcba17c22efd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:42.607344 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4260b250-de22-43bc-a6e2-dcba17c22efd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:42.607344 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4260b250-de22-43bc-a6e2-dcba17c22efd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:42.760807 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4260b250-de22-43bc-a6e2-dcba17c22efd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:42.769457 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4260b250-de22-43bc-a6e2-dcba17c22efd tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1554 microversion: 2.1 time: 0.176309 May 26 20:24:42.770032 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 80/158] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:42 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:43.418321 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-339e8c5d-3689-49cf-8c88-41e1bee4eb85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:43.418938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-339e8c5d-3689-49cf-8c88-41e1bee4eb85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:43.425475 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-339e8c5d-3689-49cf-8c88-41e1bee4eb85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:43.425924 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-339e8c5d-3689-49cf-8c88-41e1bee4eb85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:43.426715 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-339e8c5d-3689-49cf-8c88-41e1bee4eb85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:43.427207 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-339e8c5d-3689-49cf-8c88-41e1bee4eb85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:43.690166 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-339e8c5d-3689-49cf-8c88-41e1bee4eb85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:43.697677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-339e8c5d-3689-49cf-8c88-41e1bee4eb85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.283247 May 26 20:24:43.698258 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 79/159] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:43 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:43.787715 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-75efd6b6-5c12-48a3-8e5d-bd8b707703f2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:43.788886 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-75efd6b6-5c12-48a3-8e5d-bd8b707703f2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:43.811187 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75efd6b6-5c12-48a3-8e5d-bd8b707703f2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:43.812570 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75efd6b6-5c12-48a3-8e5d-bd8b707703f2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:43.814850 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75efd6b6-5c12-48a3-8e5d-bd8b707703f2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:43.815341 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75efd6b6-5c12-48a3-8e5d-bd8b707703f2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:43.996444 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-75efd6b6-5c12-48a3-8e5d-bd8b707703f2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:44.006828 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-75efd6b6-5c12-48a3-8e5d-bd8b707703f2 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1554 microversion: 2.1 time: 0.223210 May 26 20:24:44.007433 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 81/160] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:43 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:44.715819 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5f6a10d4-582e-4571-a1cf-9ae5d4036dcb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:44.716425 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5f6a10d4-582e-4571-a1cf-9ae5d4036dcb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:44.728228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5f6a10d4-582e-4571-a1cf-9ae5d4036dcb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:44.728864 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5f6a10d4-582e-4571-a1cf-9ae5d4036dcb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:44.729797 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5f6a10d4-582e-4571-a1cf-9ae5d4036dcb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:44.730706 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5f6a10d4-582e-4571-a1cf-9ae5d4036dcb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:44.756516 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-291c5fd5-b7b6-49e2-b013-2b09baef54fc req-b20e9f59-4f63-4e2a-aa29-9da81f167038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee319d6b-f1f1-4aa0-87f9-a7968127f8fb", "name": "network-vif-deleted", "tag": "6b5b82bb-9720-45e8-b150-c8e10e1ded24"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:24:44.766971 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-291c5fd5-b7b6-49e2-b013-2b09baef54fc req-b20e9f59-4f63-4e2a-aa29-9da81f167038 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:44.767627 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-291c5fd5-b7b6-49e2-b013-2b09baef54fc req-b20e9f59-4f63-4e2a-aa29-9da81f167038 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:44.782034 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-291c5fd5-b7b6-49e2-b013-2b09baef54fc req-b20e9f59-4f63-4e2a-aa29-9da81f167038 service nova] Creating event network-vif-deleted:6b5b82bb-9720-45e8-b150-c8e10e1ded24 for instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb on hv-cinder-84213 May 26 20:24:44.797337 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-291c5fd5-b7b6-49e2-b013-2b09baef54fc req-b20e9f59-4f63-4e2a-aa29-9da81f167038 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046061 May 26 20:24:44.797971 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 82/161] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:24:44.887617 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5f6a10d4-582e-4571-a1cf-9ae5d4036dcb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:44.897735 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5f6a10d4-582e-4571-a1cf-9ae5d4036dcb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.186282 May 26 20:24:44.908784 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 80/162] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:44 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:45.024700 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9faa027d-33fb-4881-9faa-446e3111ef8f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:45.025634 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9faa027d-33fb-4881-9faa-446e3111ef8f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:45.036219 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9faa027d-33fb-4881-9faa-446e3111ef8f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:45.040314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9faa027d-33fb-4881-9faa-446e3111ef8f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:45.041294 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9faa027d-33fb-4881-9faa-446e3111ef8f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:45.041748 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9faa027d-33fb-4881-9faa-446e3111ef8f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:45.133794 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9faa027d-33fb-4881-9faa-446e3111ef8f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:45.142699 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9faa027d-33fb-4881-9faa-446e3111ef8f tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1346 microversion: 2.1 time: 0.122753 May 26 20:24:45.143211 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 83/163] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:45 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:45.916410 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c7063683-281b-4a1a-84be-cb03ec743c6f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:45.917188 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c7063683-281b-4a1a-84be-cb03ec743c6f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:45.923766 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c7063683-281b-4a1a-84be-cb03ec743c6f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:45.924518 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c7063683-281b-4a1a-84be-cb03ec743c6f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:45.925363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c7063683-281b-4a1a-84be-cb03ec743c6f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:45.925795 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c7063683-281b-4a1a-84be-cb03ec743c6f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:46.073408 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c7063683-281b-4a1a-84be-cb03ec743c6f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:46.082296 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c7063683-281b-4a1a-84be-cb03ec743c6f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.170808 May 26 20:24:46.082862 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 81/164] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:45 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:46.167387 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-72bc544a-8b21-4a71-ab24-618bb55917b4 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:46.168139 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-72bc544a-8b21-4a71-ab24-618bb55917b4 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:46.178512 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-72bc544a-8b21-4a71-ab24-618bb55917b4 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:46.179134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-72bc544a-8b21-4a71-ab24-618bb55917b4 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:46.187953 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-72bc544a-8b21-4a71-ab24-618bb55917b4 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:46.188648 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-72bc544a-8b21-4a71-ab24-618bb55917b4 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:46.239676 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-72bc544a-8b21-4a71-ab24-618bb55917b4 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:46.240237 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-72bc544a-8b21-4a71-ab24-618bb55917b4 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:46.240697 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-72bc544a-8b21-4a71-ab24-618bb55917b4 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lazy-loading 'fault' on Instance uuid ee319d6b-f1f1-4aa0-87f9-a7968127f8fb {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:24:46.298907 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-72bc544a-8b21-4a71-ab24-618bb55917b4 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07dc94f1b6243d087f6d2d432a15b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc985cd350244df2b68443a15e584db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:46.310066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-72bc544a-8b21-4a71-ab24-618bb55917b4 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 200 len: 1351 microversion: 2.1 time: 0.149625 May 26 20:24:46.310682 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 84/165] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:46 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 1351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:47.100040 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-209cdaa2-3866-4f02-908f-fa5206bf678e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:47.100683 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-209cdaa2-3866-4f02-908f-fa5206bf678e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:47.106628 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-209cdaa2-3866-4f02-908f-fa5206bf678e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:47.107076 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-209cdaa2-3866-4f02-908f-fa5206bf678e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:47.107930 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-209cdaa2-3866-4f02-908f-fa5206bf678e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:47.108330 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-209cdaa2-3866-4f02-908f-fa5206bf678e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:47.292628 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-209cdaa2-3866-4f02-908f-fa5206bf678e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:47.304360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-209cdaa2-3866-4f02-908f-fa5206bf678e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.208112 May 26 20:24:47.304950 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 82/166] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:47 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:47.330164 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cd4d8762-f004-4497-bbe9-a6354fa880d3 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:47.330892 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-cd4d8762-f004-4497-bbe9-a6354fa880d3 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:47.337424 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cd4d8762-f004-4497-bbe9-a6354fa880d3 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:47.337860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cd4d8762-f004-4497-bbe9-a6354fa880d3 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:47.338657 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cd4d8762-f004-4497-bbe9-a6354fa880d3 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:47.339241 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cd4d8762-f004-4497-bbe9-a6354fa880d3 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:47.377524 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-cd4d8762-f004-4497-bbe9-a6354fa880d3 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] HTTP exception thrown: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cd4d8762-f004-4497-bbe9-a6354fa880d3 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Request method failure captured: May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb HTTP/1.1 May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-HCEjm2F-Vqz7SFy8oGII7K9ZKr9WljzgPN0L61jiYr0fLE3QsrXdebVqMX98YjaugXBoqpRDdNF6uc5i0m_2Dz9belxcorajCzCUv1dcZrzlzcMTWmhfhq67-eumCuJIN2HVi9rZ5c9LMp9LrBKOPjG0LwSzaS9N5_IdKnJhDWjRE May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: bc985cd350244df2b68443a15e584db5 May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-DeleteServersTestJSON-2145329115 May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:24:47.382330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:24:47.383751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bc985cd350244df2b68443a15e584db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bc985cd350244df2b68443a15e584db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bc985cd350244df2b68443a15e584db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bc985cd350244df2b68443a15e584db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:24:47.383751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-DeleteServersTestJSON-2145329115 May 26 20:24:47.383751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: bc985cd350244df2b68443a15e584db5 May 26 20:24:47.383751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-DeleteServersTestJSON-2145329115 May 26 20:24:47.383751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-DeleteServersTestJSON-2145329115-project May 26 20:24:47.383751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:24:47.383751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:24:47.383751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: e07dc94f1b6243d087f6d2d432a15b99 May 26 20:24:47.383751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-DeleteServersTestJSON-2145329115-project May 26 20:24:47.383751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:24:47.383751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:47.383751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': 'ee319d6b-f1f1-4aa0-87f9-a7968127f8fb'} May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:24:47.384559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:47.386079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:24:47.387460 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cd4d8762-f004-4497-bbe9-a6354fa880d3 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Returning 404 to user: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:24:47.387460 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-cd4d8762-f004-4497-bbe9-a6354fa880d3 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 404 len: 111 microversion: 2.1 time: 0.059075 May 26 20:24:47.387860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 85/167] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:47 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:24:48.034271 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-56d85c8a-cee1-4bcc-8219-5f2b018dcf4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:48.035197 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-56d85c8a-cee1-4bcc-8219-5f2b018dcf4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:48.041353 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-56d85c8a-cee1-4bcc-8219-5f2b018dcf4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:48.041981 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-56d85c8a-cee1-4bcc-8219-5f2b018dcf4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:48.043072 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-56d85c8a-cee1-4bcc-8219-5f2b018dcf4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:48.043512 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-56d85c8a-cee1-4bcc-8219-5f2b018dcf4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:48.068421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-56d85c8a-cee1-4bcc-8219-5f2b018dcf4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] HTTP exception thrown: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-56d85c8a-cee1-4bcc-8219-5f2b018dcf4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Request method failure captured: May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb/os-volume_attachments HTTP/1.1 May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HCEjm2F-Vqz7SFy8oGII7K9ZKr9WljzgPN0L61jiYr0fLE3QsrXdebVqMX98YjaugXBoqpRDdNF6uc5i0m_2Dz9belxcorajCzCUv1dcZrzlzcMTWmhfhq67-eumCuJIN2HVi9rZ5c9LMp9LrBKOPjG0LwSzaS9N5_IdKnJhDWjRE May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: bc985cd350244df2b68443a15e584db5 May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-DeleteServersTestJSON-2145329115 May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:24:48.072664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:24:48.073962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bc985cd350244df2b68443a15e584db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bc985cd350244df2b68443a15e584db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bc985cd350244df2b68443a15e584db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bc985cd350244df2b68443a15e584db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:24:48.073962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-DeleteServersTestJSON-2145329115 May 26 20:24:48.073962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: bc985cd350244df2b68443a15e584db5 May 26 20:24:48.073962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-DeleteServersTestJSON-2145329115 May 26 20:24:48.073962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-DeleteServersTestJSON-2145329115-project May 26 20:24:48.073962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:24:48.073962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:24:48.073962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: e07dc94f1b6243d087f6d2d432a15b99 May 26 20:24:48.073962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-DeleteServersTestJSON-2145329115-project May 26 20:24:48.073962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:24:48.073962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:48.073962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'server_id': 'ee319d6b-f1f1-4aa0-87f9-a7968127f8fb'} May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:24:48.074765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:48.076027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:24:48.078115 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-56d85c8a-cee1-4bcc-8219-5f2b018dcf4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Returning 404 to user: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:24:48.078997 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-56d85c8a-cee1-4bcc-8219-5f2b018dcf4e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049490 May 26 20:24:48.079737 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 83/168] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:24:48 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:24:48.326391 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a0c3f1a5-3f70-4e9b-9bd6-8a048cd2a20d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:48.327287 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a0c3f1a5-3f70-4e9b-9bd6-8a048cd2a20d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:48.333327 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a0c3f1a5-3f70-4e9b-9bd6-8a048cd2a20d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:48.333884 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a0c3f1a5-3f70-4e9b-9bd6-8a048cd2a20d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:48.334544 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a0c3f1a5-3f70-4e9b-9bd6-8a048cd2a20d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:48.335034 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a0c3f1a5-3f70-4e9b-9bd6-8a048cd2a20d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:48.472056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a0c3f1a5-3f70-4e9b-9bd6-8a048cd2a20d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:48.479491 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a0c3f1a5-3f70-4e9b-9bd6-8a048cd2a20d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.157128 May 26 20:24:48.480283 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 86/169] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:48 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:49.496633 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5d1e0e4b-4184-4951-bf18-bb04810c2770 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:49.497231 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5d1e0e4b-4184-4951-bf18-bb04810c2770 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:49.504005 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5d1e0e4b-4184-4951-bf18-bb04810c2770 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:49.504454 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5d1e0e4b-4184-4951-bf18-bb04810c2770 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:49.505224 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5d1e0e4b-4184-4951-bf18-bb04810c2770 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:49.505662 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5d1e0e4b-4184-4951-bf18-bb04810c2770 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:49.648283 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5d1e0e4b-4184-4951-bf18-bb04810c2770 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:49.656492 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5d1e0e4b-4184-4951-bf18-bb04810c2770 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.163814 May 26 20:24:49.657089 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 84/170] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:49 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:50.674876 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4aff0830-4f09-46c9-968c-3941fde5637a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:50.675500 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4aff0830-4f09-46c9-968c-3941fde5637a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:50.683960 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4aff0830-4f09-46c9-968c-3941fde5637a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:50.690682 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4aff0830-4f09-46c9-968c-3941fde5637a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:50.690682 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4aff0830-4f09-46c9-968c-3941fde5637a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:50.690682 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4aff0830-4f09-46c9-968c-3941fde5637a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:50.861143 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4aff0830-4f09-46c9-968c-3941fde5637a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:50.869104 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4aff0830-4f09-46c9-968c-3941fde5637a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.199535 May 26 20:24:50.869673 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 87/171] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:50 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:50.991890 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-99e56010-4106-40d4-a682-3288bc262f5e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:50.992769 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-99e56010-4106-40d4-a682-3288bc262f5e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:51.002077 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99e56010-4106-40d4-a682-3288bc262f5e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:51.002563 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99e56010-4106-40d4-a682-3288bc262f5e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:51.003336 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99e56010-4106-40d4-a682-3288bc262f5e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:51.004664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-99e56010-4106-40d4-a682-3288bc262f5e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:51.026813 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-99e56010-4106-40d4-a682-3288bc262f5e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] HTTP exception thrown: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-99e56010-4106-40d4-a682-3288bc262f5e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Request method failure captured: May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: DELETE /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb HTTP/1.1 May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HCEjm2F-Vqz7SFy8oGII7K9ZKr9WljzgPN0L61jiYr0fLE3QsrXdebVqMX98YjaugXBoqpRDdNF6uc5i0m_2Dz9belxcorajCzCUv1dcZrzlzcMTWmhfhq67-eumCuJIN2HVi9rZ5c9LMp9LrBKOPjG0LwSzaS9N5_IdKnJhDWjRE May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: bc985cd350244df2b68443a15e584db5 May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-DeleteServersTestJSON-2145329115 May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:24:51.030050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:24:51.032280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bc985cd350244df2b68443a15e584db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bc985cd350244df2b68443a15e584db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bc985cd350244df2b68443a15e584db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bc985cd350244df2b68443a15e584db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:24:51.032280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-DeleteServersTestJSON-2145329115 May 26 20:24:51.032280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: bc985cd350244df2b68443a15e584db5 May 26 20:24:51.032280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-DeleteServersTestJSON-2145329115 May 26 20:24:51.032280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-DeleteServersTestJSON-2145329115-project May 26 20:24:51.032280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:24:51.032280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:24:51.032280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: e07dc94f1b6243d087f6d2d432a15b99 May 26 20:24:51.032280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-DeleteServersTestJSON-2145329115-project May 26 20:24:51.032280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:24:51.032280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:51.032280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': 'ee319d6b-f1f1-4aa0-87f9-a7968127f8fb'} May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:24:51.033971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:51.035572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:24:51.038479 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-99e56010-4106-40d4-a682-3288bc262f5e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Returning 404 to user: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:24:51.039691 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-99e56010-4106-40d4-a682-3288bc262f5e tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 404 len: 111 microversion: 2.1 time: 0.057467 May 26 20:24:51.040544 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 85/172] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:24:50 2022] DELETE /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:24:51.057374 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b7c25b74-e43a-452a-898d-8f03be11cef0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:51.058721 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b7c25b74-e43a-452a-898d-8f03be11cef0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] [instance: ee319d6b-f1f1-4aa0-87f9-a7968127f8fb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:51.068147 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b7c25b74-e43a-452a-898d-8f03be11cef0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:51.069299 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b7c25b74-e43a-452a-898d-8f03be11cef0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:51.071698 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b7c25b74-e43a-452a-898d-8f03be11cef0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:51.072565 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b7c25b74-e43a-452a-898d-8f03be11cef0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:51.094989 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-b7c25b74-e43a-452a-898d-8f03be11cef0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] HTTP exception thrown: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b7c25b74-e43a-452a-898d-8f03be11cef0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Request method failure captured: May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb HTTP/1.1 May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-HCEjm2F-Vqz7SFy8oGII7K9ZKr9WljzgPN0L61jiYr0fLE3QsrXdebVqMX98YjaugXBoqpRDdNF6uc5i0m_2Dz9belxcorajCzCUv1dcZrzlzcMTWmhfhq67-eumCuJIN2HVi9rZ5c9LMp9LrBKOPjG0LwSzaS9N5_IdKnJhDWjRE May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: bc985cd350244df2b68443a15e584db5 May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-DeleteServersTestJSON-2145329115 May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:24:51.097056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:24:51.099949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bc985cd350244df2b68443a15e584db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bc985cd350244df2b68443a15e584db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bc985cd350244df2b68443a15e584db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bc985cd350244df2b68443a15e584db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:24:51.099949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-DeleteServersTestJSON-2145329115 May 26 20:24:51.099949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: bc985cd350244df2b68443a15e584db5 May 26 20:24:51.099949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-DeleteServersTestJSON-2145329115 May 26 20:24:51.099949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-DeleteServersTestJSON-2145329115-project May 26 20:24:51.099949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:24:51.099949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:24:51.099949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: e07dc94f1b6243d087f6d2d432a15b99 May 26 20:24:51.099949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-DeleteServersTestJSON-2145329115-project May 26 20:24:51.099949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:24:51.099949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:51.099949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': 'ee319d6b-f1f1-4aa0-87f9-a7968127f8fb'} May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:24:51.101114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. May 26 20:24:51.102619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:24:51.106925 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b7c25b74-e43a-452a-898d-8f03be11cef0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] Returning 404 to user: Instance ee319d6b-f1f1-4aa0-87f9-a7968127f8fb could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:24:51.106925 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b7c25b74-e43a-452a-898d-8f03be11cef0 tempest-DeleteServersTestJSON-2145329115 tempest-DeleteServersTestJSON-2145329115-project] 10.222.0.44 "GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb" status: 404 len: 111 microversion: 2.1 time: 0.047971 May 26 20:24:51.106925 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 88/173] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:51 2022] GET /compute/v2.1/servers/ee319d6b-f1f1-4aa0-87f9-a7968127f8fb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:24:51.783878 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-872190693", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:24:51.855796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] validate_networks() for None {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:24:51.888335 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-936ff0be-5a10-4eed-a092-1081d58c9e85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:51.890435 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-936ff0be-5a10-4eed-a092-1081d58c9e85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:51.898385 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-936ff0be-5a10-4eed-a092-1081d58c9e85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:51.898821 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-936ff0be-5a10-4eed-a092-1081d58c9e85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:51.899588 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-936ff0be-5a10-4eed-a092-1081d58c9e85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:51.900038 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-936ff0be-5a10-4eed-a092-1081d58c9e85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:52.106581 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-936ff0be-5a10-4eed-a092-1081d58c9e85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:52.127521 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-936ff0be-5a10-4eed-a092-1081d58c9e85 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.235660 May 26 20:24:52.127521 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 89/174] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:51 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:52.463125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:24:52.463586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:24:52.466305 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:24:52.466305 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:24:52.466305 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:24:52.475070 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:52.475470 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:52.476259 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:52.476687 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:52.503778 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Getting quotas for project bcb014814b18450381628161307a56d5. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:24:52.508045 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Getting quotas for user ad08fb22e1a0432eb8d09389cdfb17d4 and project bcb014814b18450381628161307a56d5. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:24:52.521651 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:24:52.524563 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:24:52.681178 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6d61caf7-0635-4586-a074-aa8200d6d6cd tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902698 May 26 20:24:52.682094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 86/175] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:24:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:24:52.692471 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-db54a837-c910-4090-a09c-ce7c6094b59f tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:52.693118 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-db54a837-c910-4090-a09c-ce7c6094b59f tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:52.763615 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-db54a837-c910-4090-a09c-ce7c6094b59f tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:52.773369 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-db54a837-c910-4090-a09c-ce7c6094b59f tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1214 microversion: 2.1 time: 0.084639 May 26 20:24:52.783723 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 90/176] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:52 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:53.141630 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d0703ddd-ed8a-4bba-b23c-f65a3d9673ae tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:53.142273 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d0703ddd-ed8a-4bba-b23c-f65a3d9673ae tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:53.149629 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0703ddd-ed8a-4bba-b23c-f65a3d9673ae tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:53.150093 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0703ddd-ed8a-4bba-b23c-f65a3d9673ae tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:53.150902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0703ddd-ed8a-4bba-b23c-f65a3d9673ae tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:53.151342 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0703ddd-ed8a-4bba-b23c-f65a3d9673ae tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:53.295350 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-d0703ddd-ed8a-4bba-b23c-f65a3d9673ae tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:53.304332 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d0703ddd-ed8a-4bba-b23c-f65a3d9673ae tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.167308 May 26 20:24:53.304881 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 87/177] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:53 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:53.791331 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-333f2981-54d5-42c8-9766-830a7501461e tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:53.792013 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-333f2981-54d5-42c8-9766-830a7501461e tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:53.846902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-333f2981-54d5-42c8-9766-830a7501461e tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:53.854174 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-333f2981-54d5-42c8-9766-830a7501461e tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1214 microversion: 2.1 time: 0.066776 May 26 20:24:53.854754 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 91/178] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:53 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:54.320508 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6680ee9b-ee92-4ab2-a361-ddd681daf6eb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:54.321158 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6680ee9b-ee92-4ab2-a361-ddd681daf6eb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:54.327779 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6680ee9b-ee92-4ab2-a361-ddd681daf6eb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:54.328379 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6680ee9b-ee92-4ab2-a361-ddd681daf6eb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:54.329213 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6680ee9b-ee92-4ab2-a361-ddd681daf6eb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:54.329719 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6680ee9b-ee92-4ab2-a361-ddd681daf6eb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:54.548489 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6680ee9b-ee92-4ab2-a361-ddd681daf6eb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:54.557313 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6680ee9b-ee92-4ab2-a361-ddd681daf6eb tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.240566 May 26 20:24:54.557895 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 88/179] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:54 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:54.871886 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6c60cf73-e5d2-4869-ac91-1fffd1fbbb83 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:54.872499 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6c60cf73-e5d2-4869-ac91-1fffd1fbbb83 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:54.880113 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6c60cf73-e5d2-4869-ac91-1fffd1fbbb83 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:54.880563 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6c60cf73-e5d2-4869-ac91-1fffd1fbbb83 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:54.881331 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6c60cf73-e5d2-4869-ac91-1fffd1fbbb83 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:54.881767 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6c60cf73-e5d2-4869-ac91-1fffd1fbbb83 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:54.949179 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6c60cf73-e5d2-4869-ac91-1fffd1fbbb83 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:54.953941 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=100 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:54.958785 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6c60cf73-e5d2-4869-ac91-1fffd1fbbb83 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1218 microversion: 2.1 time: 0.090748 May 26 20:24:54.964455 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 92/180] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:54 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:55.574042 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3deab4bf-fe06-4ed7-a657-183c62922e71 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:55.574683 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3deab4bf-fe06-4ed7-a657-183c62922e71 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:55.582739 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3deab4bf-fe06-4ed7-a657-183c62922e71 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:55.583199 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3deab4bf-fe06-4ed7-a657-183c62922e71 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:55.583978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3deab4bf-fe06-4ed7-a657-183c62922e71 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:55.584419 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3deab4bf-fe06-4ed7-a657-183c62922e71 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:55.820954 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-3deab4bf-fe06-4ed7-a657-183c62922e71 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:55.835951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3deab4bf-fe06-4ed7-a657-183c62922e71 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.265576 May 26 20:24:55.837375 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 89/181] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:55 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:55.978551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5b5b353b-250c-4326-b1b0-b4294df5a4db tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:55.979830 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5b5b353b-250c-4326-b1b0-b4294df5a4db tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:55.989511 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5b5b353b-250c-4326-b1b0-b4294df5a4db tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:55.990317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5b5b353b-250c-4326-b1b0-b4294df5a4db tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:55.991334 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5b5b353b-250c-4326-b1b0-b4294df5a4db tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:55.991824 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5b5b353b-250c-4326-b1b0-b4294df5a4db tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:56.109122 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5b5b353b-250c-4326-b1b0-b4294df5a4db tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:56.116692 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5b5b353b-250c-4326-b1b0-b4294df5a4db tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1210 microversion: 2.1 time: 0.143396 May 26 20:24:56.117273 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 93/182] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:55 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1210 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:56.855623 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0824c06a-c05b-4ec4-ba38-f6c3127571c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:56.857416 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0824c06a-c05b-4ec4-ba38-f6c3127571c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:56.871261 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0824c06a-c05b-4ec4-ba38-f6c3127571c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:56.878105 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0824c06a-c05b-4ec4-ba38-f6c3127571c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:56.879499 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0824c06a-c05b-4ec4-ba38-f6c3127571c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:56.879932 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0824c06a-c05b-4ec4-ba38-f6c3127571c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:57.135421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-0824c06a-c05b-4ec4-ba38-f6c3127571c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:57.142350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-022d36de-f7ad-46d4-9678-2b8ff180f187 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:57.142350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-022d36de-f7ad-46d4-9678-2b8ff180f187 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:57.147392 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-022d36de-f7ad-46d4-9678-2b8ff180f187 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:57.147864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-022d36de-f7ad-46d4-9678-2b8ff180f187 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:57.148622 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-022d36de-f7ad-46d4-9678-2b8ff180f187 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:57.149221 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-022d36de-f7ad-46d4-9678-2b8ff180f187 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:57.151731 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:57.156296 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0824c06a-c05b-4ec4-ba38-f6c3127571c5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.306337 May 26 20:24:57.157160 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 90/183] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:56 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:57.238110 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-022d36de-f7ad-46d4-9678-2b8ff180f187 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:57.248029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-022d36de-f7ad-46d4-9678-2b8ff180f187 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1266 microversion: 2.1 time: 0.113450 May 26 20:24:57.248442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 94/184] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:57 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:24:58.173443 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9116e8cb-8cdf-4fb0-99b1-2d2bb3fd66ca tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:58.174146 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9116e8cb-8cdf-4fb0-99b1-2d2bb3fd66ca tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:58.186502 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9116e8cb-8cdf-4fb0-99b1-2d2bb3fd66ca tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:58.190189 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9116e8cb-8cdf-4fb0-99b1-2d2bb3fd66ca tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:58.191150 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9116e8cb-8cdf-4fb0-99b1-2d2bb3fd66ca tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:58.191673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9116e8cb-8cdf-4fb0-99b1-2d2bb3fd66ca tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:58.265558 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-85a7c8d9-5871-40ea-9502-881e3ce34c4a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:58.266889 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-85a7c8d9-5871-40ea-9502-881e3ce34c4a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:58.283188 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-85a7c8d9-5871-40ea-9502-881e3ce34c4a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:58.283645 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-85a7c8d9-5871-40ea-9502-881e3ce34c4a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:58.284429 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-85a7c8d9-5871-40ea-9502-881e3ce34c4a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:58.288356 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-85a7c8d9-5871-40ea-9502-881e3ce34c4a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:58.407338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-85a7c8d9-5871-40ea-9502-881e3ce34c4a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:58.418053 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-85a7c8d9-5871-40ea-9502-881e3ce34c4a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1274 microversion: 2.1 time: 0.156966 May 26 20:24:58.427720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 95/185] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:58 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:58.494056 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9116e8cb-8cdf-4fb0-99b1-2d2bb3fd66ca tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:58.504496 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9116e8cb-8cdf-4fb0-99b1-2d2bb3fd66ca tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1521 microversion: 2.1 time: 0.334642 May 26 20:24:58.505645 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 91/186] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:58 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:24:59.444299 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-932a215c-8cab-4e8b-b097-8f8cffd75c45 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:59.445009 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-932a215c-8cab-4e8b-b097-8f8cffd75c45 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:59.452002 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-932a215c-8cab-4e8b-b097-8f8cffd75c45 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:59.456849 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-932a215c-8cab-4e8b-b097-8f8cffd75c45 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:59.456849 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-932a215c-8cab-4e8b-b097-8f8cffd75c45 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:59.456849 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-932a215c-8cab-4e8b-b097-8f8cffd75c45 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:59.521630 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2368fbe5-55b4-4bb8-acb5-1186c00889e0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:24:59.522299 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2368fbe5-55b4-4bb8-acb5-1186c00889e0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:24:59.528810 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2368fbe5-55b4-4bb8-acb5-1186c00889e0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:59.529478 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2368fbe5-55b4-4bb8-acb5-1186c00889e0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:59.530827 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2368fbe5-55b4-4bb8-acb5-1186c00889e0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:24:59.532202 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2368fbe5-55b4-4bb8-acb5-1186c00889e0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:24:59.589343 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-932a215c-8cab-4e8b-b097-8f8cffd75c45 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:24:59.598501 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-932a215c-8cab-4e8b-b097-8f8cffd75c45 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1272 microversion: 2.1 time: 0.158339 May 26 20:24:59.617116 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 96/187] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:59 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:00.000297 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2368fbe5-55b4-4bb8-acb5-1186c00889e0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:00.012238 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2368fbe5-55b4-4bb8-acb5-1186c00889e0 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1501 microversion: 2.1 time: 0.491721 May 26 20:25:00.018385 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 92/188] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:24:59 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1501 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:00.041785 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-f416aff7-cc71-4431-a33b-e97eadd37a9b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:00.042766 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-f416aff7-cc71-4431-a33b-e97eadd37a9b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:00.057702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f416aff7-cc71-4431-a33b-e97eadd37a9b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:00.058490 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f416aff7-cc71-4431-a33b-e97eadd37a9b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:00.060405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f416aff7-cc71-4431-a33b-e97eadd37a9b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:00.061097 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f416aff7-cc71-4431-a33b-e97eadd37a9b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:00.497577 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-f416aff7-cc71-4431-a33b-e97eadd37a9b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:00.517852 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-f416aff7-cc71-4431-a33b-e97eadd37a9b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1516 microversion: 2.1 time: 0.486395 May 26 20:25:00.518914 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 97/189] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:00 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1516 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:00.621170 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a22125d6-d8b6-405c-a0d4-7d580e689225 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:00.621989 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a22125d6-d8b6-405c-a0d4-7d580e689225 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:00.659953 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a22125d6-d8b6-405c-a0d4-7d580e689225 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:00.661859 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a22125d6-d8b6-405c-a0d4-7d580e689225 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:00.664764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a22125d6-d8b6-405c-a0d4-7d580e689225 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:00.665345 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a22125d6-d8b6-405c-a0d4-7d580e689225 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:01.320054 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a22125d6-d8b6-405c-a0d4-7d580e689225 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:01.334438 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a22125d6-d8b6-405c-a0d4-7d580e689225 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1314 microversion: 2.1 time: 0.718348 May 26 20:25:01.365011 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 93/190] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:00 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:02.071214 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a96b9030-f771-4ece-baec-6f4a37bda29f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: .version_select at 0x7f2da480a040>, body: {"keypair": {"name": "tempest-keypair-116663722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq1kG0u9JpPtC7lojDVeoUHipNY/wUnO+lcBanDZi7Sc4XjkssXqjHMxe6wqnYY6u7V03gDUOwRi1NDO9hBXrJDTxJHq3iyGGEM/SPPL8yBgrTVIb625l2wOAFHupZyWA=="}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:02.087815 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=56 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:02.101052 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-a96b9030-f771-4ece-baec-6f4a37bda29f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:25:02.107178 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-a96b9030-f771-4ece-baec-6f4a37bda29f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for user f57c87dc60754d3aa87a84605c7a6889 and project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:25:02.304793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a96b9030-f771-4ece-baec-6f4a37bda29f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.439988 May 26 20:25:02.308794 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 98/191] 10.222.0.44 () {60 vars in 1158 bytes} [Thu May 26 20:25:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:02.352699 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-51400953-7e57-45fb-a329-cf3b5c1e4b30 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:02.353299 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-51400953-7e57-45fb-a329-cf3b5c1e4b30 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:02.362310 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51400953-7e57-45fb-a329-cf3b5c1e4b30 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:02.365337 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51400953-7e57-45fb-a329-cf3b5c1e4b30 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:02.366375 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51400953-7e57-45fb-a329-cf3b5c1e4b30 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:02.368716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-51400953-7e57-45fb-a329-cf3b5c1e4b30 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:02.484440 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:02.516332 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:02.542723 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-b429d4ab-9561-4299-a06d-61f36b06452c req-9ecd63ba-5e3b-41e2-a41e-605f32d2f669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e", "tag": "feaad53b-7798-4b0e-8e7e-6de0edb3d3b8"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:02.556597 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-b429d4ab-9561-4299-a06d-61f36b06452c req-9ecd63ba-5e3b-41e2-a41e-605f32d2f669 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:02.557285 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-b429d4ab-9561-4299-a06d-61f36b06452c req-9ecd63ba-5e3b-41e2-a41e-605f32d2f669 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:02.584217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-b429d4ab-9561-4299-a06d-61f36b06452c req-9ecd63ba-5e3b-41e2-a41e-605f32d2f669 service nova] Creating event network-changed:feaad53b-7798-4b0e-8e7e-6de0edb3d3b8 for instance 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e on hv-cinder-84213 May 26 20:25:02.591715 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-b429d4ab-9561-4299-a06d-61f36b06452c req-9ecd63ba-5e3b-41e2-a41e-605f32d2f669 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053168 May 26 20:25:02.593415 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 99/192] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:02.601835 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9ff753e9-d7cd-4f8f-904b-9af17d8738bd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:02.601835 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9ff753e9-d7cd-4f8f-904b-9af17d8738bd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:02.609060 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9ff753e9-d7cd-4f8f-904b-9af17d8738bd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:02.609673 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9ff753e9-d7cd-4f8f-904b-9af17d8738bd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:02.610494 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9ff753e9-d7cd-4f8f-904b-9af17d8738bd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:02.610931 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9ff753e9-d7cd-4f8f-904b-9af17d8738bd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:02.672874 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-9ff753e9-d7cd-4f8f-904b-9af17d8738bd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lazy-loading 'flavor' on Instance uuid 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:25:02.813163 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-51400953-7e57-45fb-a329-cf3b5c1e4b30 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:02.826749 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-51400953-7e57-45fb-a329-cf3b5c1e4b30 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1314 microversion: 2.1 time: 0.477759 May 26 20:25:02.833213 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 94/193] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:02 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:03.198372 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9ff753e9-d7cd-4f8f-904b-9af17d8738bd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "POST /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab/action" status: 200 len: 32 microversion: 2.1 time: 0.602097 May 26 20:25:03.202091 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 100/194] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:25:02 2022] POST /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab/action => generated 32 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 20:25:03.208346 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-35d108a0-6d37-45d4-bf1c-0b3e62a9185e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:03.209184 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-35d108a0-6d37-45d4-bf1c-0b3e62a9185e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:03.229911 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:03.232906 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-35d108a0-6d37-45d4-bf1c-0b3e62a9185e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:03.234815 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-35d108a0-6d37-45d4-bf1c-0b3e62a9185e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:03.235940 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-35d108a0-6d37-45d4-bf1c-0b3e62a9185e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:03.236703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-35d108a0-6d37-45d4-bf1c-0b3e62a9185e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:03.703570 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-35d108a0-6d37-45d4-bf1c-0b3e62a9185e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:03.712913 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-35d108a0-6d37-45d4-bf1c-0b3e62a9185e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.509776 May 26 20:25:03.714184 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 95/195] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:03 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:03.850700 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b9cccb2a-a9df-463e-acd6-2fd27e8a5ca1 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:03.852680 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b9cccb2a-a9df-463e-acd6-2fd27e8a5ca1 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:03.864177 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b9cccb2a-a9df-463e-acd6-2fd27e8a5ca1 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:03.867671 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b9cccb2a-a9df-463e-acd6-2fd27e8a5ca1 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:03.867671 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b9cccb2a-a9df-463e-acd6-2fd27e8a5ca1 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:03.867671 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b9cccb2a-a9df-463e-acd6-2fd27e8a5ca1 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:04.139399 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b9cccb2a-a9df-463e-acd6-2fd27e8a5ca1 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:04.151534 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b9cccb2a-a9df-463e-acd6-2fd27e8a5ca1 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1314 microversion: 2.1 time: 0.307240 May 26 20:25:04.152730 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 101/196] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:03 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:04.730313 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4f4634e2-62c4-423c-81df-a71d01c6a184 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:04.730927 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4f4634e2-62c4-423c-81df-a71d01c6a184 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:04.750528 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f4634e2-62c4-423c-81df-a71d01c6a184 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:04.751270 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f4634e2-62c4-423c-81df-a71d01c6a184 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:04.755744 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f4634e2-62c4-423c-81df-a71d01c6a184 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:04.756889 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f4634e2-62c4-423c-81df-a71d01c6a184 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:05.169738 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-bc31390b-3d6d-4052-9801-6f1a2136528c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:05.171072 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-bc31390b-3d6d-4052-9801-6f1a2136528c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:05.180020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bc31390b-3d6d-4052-9801-6f1a2136528c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:05.180953 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bc31390b-3d6d-4052-9801-6f1a2136528c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:05.183083 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bc31390b-3d6d-4052-9801-6f1a2136528c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:05.184447 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bc31390b-3d6d-4052-9801-6f1a2136528c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:05.389007 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-bc31390b-3d6d-4052-9801-6f1a2136528c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:05.399080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-bc31390b-3d6d-4052-9801-6f1a2136528c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1314 microversion: 2.1 time: 0.233835 May 26 20:25:05.402027 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 102/197] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:05 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:05.632504 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-4f4634e2-62c4-423c-81df-a71d01c6a184 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:05.641394 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4f4634e2-62c4-423c-81df-a71d01c6a184 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.915190 May 26 20:25:05.642709 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 96/198] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:04 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:06.413958 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-594325329", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d8f9587-b15f-4a25-9b7c-c72960c971d6"}], "security_groups": [{"name": "tempest-securitygroup--1285525944"}], "key_name": "tempest-keypair-116663722", "user_data": "}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:06.419394 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3beb4fbb-e40a-4b58-8472-944db0002f17 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:06.419813 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3beb4fbb-e40a-4b58-8472-944db0002f17 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:06.429839 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3beb4fbb-e40a-4b58-8472-944db0002f17 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:06.430311 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3beb4fbb-e40a-4b58-8472-944db0002f17 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:06.431097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3beb4fbb-e40a-4b58-8472-944db0002f17 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:06.431538 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3beb4fbb-e40a-4b58-8472-944db0002f17 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:06.585921 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.network.neutron [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] validate_networks() for [('0d8f9587-b15f-4a25-9b7c-c72960c971d6', None, None, None, None, None)] {{(pid=118306) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:25:06.637538 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-3beb4fbb-e40a-4b58-8472-944db0002f17 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:06.646298 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3beb4fbb-e40a-4b58-8472-944db0002f17 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1314 microversion: 2.1 time: 0.230882 May 26 20:25:06.646880 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 97/199] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:06 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:06.662006 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-383ecd9f-8350-41c5-b167-831a0df9c44b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:06.663110 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-383ecd9f-8350-41c5-b167-831a0df9c44b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:06.669459 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-383ecd9f-8350-41c5-b167-831a0df9c44b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:06.669910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-383ecd9f-8350-41c5-b167-831a0df9c44b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:06.671024 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-383ecd9f-8350-41c5-b167-831a0df9c44b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:06.671609 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-383ecd9f-8350-41c5-b167-831a0df9c44b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:06.892196 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-383ecd9f-8350-41c5-b167-831a0df9c44b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:06.909744 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-383ecd9f-8350-41c5-b167-831a0df9c44b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.251471 May 26 20:25:06.920537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 98/200] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:06 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:07.083568 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Flavor limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:25:07.084928 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Image limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:25:07.085290 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Flavor pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:25:07.085708 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Image pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:25:07.086182 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:25:07.099053 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:07.099894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:07.101210 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:07.101746 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:07.125653 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:25:07.130799 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for user f57c87dc60754d3aa87a84605c7a6889 and project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:25:07.143234 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Going to run 1 instances... {{(pid=118306) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:25:07.145824 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:25:07.261053 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-085ec93b-f184-4bf2-8758-ed00647f1e78 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.857920 May 26 20:25:07.261706 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 103/201] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:25:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:25:07.272280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1a9bfa6e-c7d7-4161-b559-79138bd1eccd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:07.272928 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1a9bfa6e-c7d7-4161-b559-79138bd1eccd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:07.326123 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-1a9bfa6e-c7d7-4161-b559-79138bd1eccd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:07.335681 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1a9bfa6e-c7d7-4161-b559-79138bd1eccd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1240 microversion: 2.1 time: 0.067655 May 26 20:25:07.336684 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 99/202] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:07 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:07.664766 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4af0a9a7-ae23-4399-9b41-936a85f0619a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:07.665471 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4af0a9a7-ae23-4399-9b41-936a85f0619a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:07.675569 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4af0a9a7-ae23-4399-9b41-936a85f0619a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:07.676009 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4af0a9a7-ae23-4399-9b41-936a85f0619a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:07.676777 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4af0a9a7-ae23-4399-9b41-936a85f0619a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:07.677206 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4af0a9a7-ae23-4399-9b41-936a85f0619a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:07.887852 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4af0a9a7-ae23-4399-9b41-936a85f0619a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:07.916632 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4af0a9a7-ae23-4399-9b41-936a85f0619a tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1314 microversion: 2.1 time: 0.248795 May 26 20:25:07.916632 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 104/203] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:07 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:07.931654 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3e583ffd-7733-49bb-aad5-ab7aa107b7e8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:07.931654 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3e583ffd-7733-49bb-aad5-ab7aa107b7e8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:07.934872 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e583ffd-7733-49bb-aad5-ab7aa107b7e8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:07.935312 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e583ffd-7733-49bb-aad5-ab7aa107b7e8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:07.936073 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e583ffd-7733-49bb-aad5-ab7aa107b7e8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:07.937457 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e583ffd-7733-49bb-aad5-ab7aa107b7e8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:08.111377 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-3e583ffd-7733-49bb-aad5-ab7aa107b7e8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:08.114944 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3e583ffd-7733-49bb-aad5-ab7aa107b7e8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.190931 May 26 20:25:08.115840 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 100/204] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:07 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:08.353039 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e93b31eb-9ec1-45f3-b3c2-cf70cb990286 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:08.353892 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e93b31eb-9ec1-45f3-b3c2-cf70cb990286 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:08.425656 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e93b31eb-9ec1-45f3-b3c2-cf70cb990286 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:08.433238 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e93b31eb-9ec1-45f3-b3c2-cf70cb990286 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1240 microversion: 2.1 time: 0.084049 May 26 20:25:08.433797 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 105/205] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:08 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:08.927493 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d40043b8-b504-4622-a13f-e19f15b6fb85 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:08.928110 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d40043b8-b504-4622-a13f-e19f15b6fb85 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:08.934407 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d40043b8-b504-4622-a13f-e19f15b6fb85 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:08.935077 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d40043b8-b504-4622-a13f-e19f15b6fb85 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:08.935731 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d40043b8-b504-4622-a13f-e19f15b6fb85 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:08.936186 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d40043b8-b504-4622-a13f-e19f15b6fb85 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:09.078090 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-d40043b8-b504-4622-a13f-e19f15b6fb85 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:09.086032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d40043b8-b504-4622-a13f-e19f15b6fb85 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1314 microversion: 2.1 time: 0.162569 May 26 20:25:09.087202 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 101/206] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:08 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:09.132922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9aeaeaef-186c-4f89-85a0-48c124ccd8f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:09.133530 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9aeaeaef-186c-4f89-85a0-48c124ccd8f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:09.142179 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9aeaeaef-186c-4f89-85a0-48c124ccd8f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:09.142648 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9aeaeaef-186c-4f89-85a0-48c124ccd8f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:09.143473 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9aeaeaef-186c-4f89-85a0-48c124ccd8f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:09.143905 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9aeaeaef-186c-4f89-85a0-48c124ccd8f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:09.281818 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9aeaeaef-186c-4f89-85a0-48c124ccd8f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:09.290680 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9aeaeaef-186c-4f89-85a0-48c124ccd8f8 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.161739 May 26 20:25:09.291203 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 106/207] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:09 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:09.450029 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b532dd8d-c6c6-4e52-96e7-a593cfee8c7b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:09.450702 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b532dd8d-c6c6-4e52-96e7-a593cfee8c7b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:09.457150 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b532dd8d-c6c6-4e52-96e7-a593cfee8c7b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:09.457604 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b532dd8d-c6c6-4e52-96e7-a593cfee8c7b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:09.458402 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b532dd8d-c6c6-4e52-96e7-a593cfee8c7b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:09.458849 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b532dd8d-c6c6-4e52-96e7-a593cfee8c7b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:09.522032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b532dd8d-c6c6-4e52-96e7-a593cfee8c7b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:09.529557 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b532dd8d-c6c6-4e52-96e7-a593cfee8c7b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1292 microversion: 2.1 time: 0.083412 May 26 20:25:09.530808 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 102/208] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:09 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:10.114891 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-514bb246-80f7-475e-af65-599e49aff94d tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:10.114891 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-514bb246-80f7-475e-af65-599e49aff94d tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:10.115774 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-849bca14-e2d4-44bd-b8f3-a14d72b1eb51 req-22969d21-5203-4658-8c3f-342f97fcff5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e", "name": "network-vif-plugged", "status": "completed", "tag": "feaad53b-7798-4b0e-8e7e-6de0edb3d3b8"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:10.145667 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-849bca14-e2d4-44bd-b8f3-a14d72b1eb51 req-22969d21-5203-4658-8c3f-342f97fcff5a service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:10.146336 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-849bca14-e2d4-44bd-b8f3-a14d72b1eb51 req-22969d21-5203-4658-8c3f-342f97fcff5a service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:10.148686 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-514bb246-80f7-475e-af65-599e49aff94d tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:10.149158 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-514bb246-80f7-475e-af65-599e49aff94d tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:10.149972 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-514bb246-80f7-475e-af65-599e49aff94d tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:10.150524 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-514bb246-80f7-475e-af65-599e49aff94d tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:10.163620 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-849bca14-e2d4-44bd-b8f3-a14d72b1eb51 req-22969d21-5203-4658-8c3f-342f97fcff5a service nova] Creating event network-vif-plugged:feaad53b-7798-4b0e-8e7e-6de0edb3d3b8 for instance 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e on hv-cinder-84213 May 26 20:25:10.173269 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-849bca14-e2d4-44bd-b8f3-a14d72b1eb51 req-22969d21-5203-4658-8c3f-342f97fcff5a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072377 May 26 20:25:10.177681 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 107/209] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:25:10.312500 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8aa8c8ae-5083-438b-8bfd-725b32242654 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:10.313261 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8aa8c8ae-5083-438b-8bfd-725b32242654 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:10.333748 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8aa8c8ae-5083-438b-8bfd-725b32242654 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:10.334967 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8aa8c8ae-5083-438b-8bfd-725b32242654 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:10.335993 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8aa8c8ae-5083-438b-8bfd-725b32242654 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:10.336640 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8aa8c8ae-5083-438b-8bfd-725b32242654 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:10.377273 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-514bb246-80f7-475e-af65-599e49aff94d tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:10.384807 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-514bb246-80f7-475e-af65-599e49aff94d tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1314 microversion: 2.1 time: 0.279986 May 26 20:25:10.385407 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 103/210] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:10 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:10.480034 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8aa8c8ae-5083-438b-8bfd-725b32242654 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:10.489745 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8aa8c8ae-5083-438b-8bfd-725b32242654 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.181969 May 26 20:25:10.490355 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 108/211] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:10 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:10.548359 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-92e1e2bf-6b6f-4173-8631-6f82e3fb1f1a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:10.549041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-92e1e2bf-6b6f-4173-8631-6f82e3fb1f1a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:10.555800 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-92e1e2bf-6b6f-4173-8631-6f82e3fb1f1a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:10.556263 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-92e1e2bf-6b6f-4173-8631-6f82e3fb1f1a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:10.557032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-92e1e2bf-6b6f-4173-8631-6f82e3fb1f1a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:10.557649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-92e1e2bf-6b6f-4173-8631-6f82e3fb1f1a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:10.643958 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-92e1e2bf-6b6f-4173-8631-6f82e3fb1f1a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:10.651804 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-92e1e2bf-6b6f-4173-8631-6f82e3fb1f1a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1298 microversion: 2.1 time: 0.108051 May 26 20:25:10.662235 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 104/212] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:10 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1298 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:11.404837 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-90ed2bd5-ee9c-42cf-8460-275772fbd22e tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:11.406718 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-90ed2bd5-ee9c-42cf-8460-275772fbd22e tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:11.413380 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-90ed2bd5-ee9c-42cf-8460-275772fbd22e tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:11.413817 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-90ed2bd5-ee9c-42cf-8460-275772fbd22e tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:11.414779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-90ed2bd5-ee9c-42cf-8460-275772fbd22e tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:11.415359 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-90ed2bd5-ee9c-42cf-8460-275772fbd22e tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:11.511132 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cda27a4b-9bb6-4388-9930-facf93d8c103 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:11.511132 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cda27a4b-9bb6-4388-9930-facf93d8c103 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:11.518043 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cda27a4b-9bb6-4388-9930-facf93d8c103 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:11.518477 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cda27a4b-9bb6-4388-9930-facf93d8c103 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:11.521401 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cda27a4b-9bb6-4388-9930-facf93d8c103 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:11.521861 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cda27a4b-9bb6-4388-9930-facf93d8c103 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:11.610348 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-90ed2bd5-ee9c-42cf-8460-275772fbd22e tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:11.618094 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-90ed2bd5-ee9c-42cf-8460-275772fbd22e tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1314 microversion: 2.1 time: 0.217058 May 26 20:25:11.618696 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 109/213] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:11 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:11.670347 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-30554ed1-709c-4f94-a544-5fcaa1638793 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:11.672169 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-30554ed1-709c-4f94-a544-5fcaa1638793 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:11.681137 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-30554ed1-709c-4f94-a544-5fcaa1638793 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:11.681577 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-30554ed1-709c-4f94-a544-5fcaa1638793 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:11.694279 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-30554ed1-709c-4f94-a544-5fcaa1638793 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:11.695109 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-30554ed1-709c-4f94-a544-5fcaa1638793 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:11.790895 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cda27a4b-9bb6-4388-9930-facf93d8c103 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:11.803512 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cda27a4b-9bb6-4388-9930-facf93d8c103 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.299531 May 26 20:25:11.815975 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 105/214] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:11 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:11.903081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-30554ed1-709c-4f94-a544-5fcaa1638793 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:11.924484 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-30554ed1-709c-4f94-a544-5fcaa1638793 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1366 microversion: 2.1 time: 0.258674 May 26 20:25:11.925075 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 110/215] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:11 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:12.409286 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-f2fd57d9-4fe4-4ddb-aa24-766efebd516b req-4d13051f-9877-4fea-9a79-03d07de6c750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a2054d-de32-402c-8f6a-2f753925164d", "tag": "22b9f953-2c86-4d1f-ac22-5abc810169c7"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:12.421009 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f2fd57d9-4fe4-4ddb-aa24-766efebd516b req-4d13051f-9877-4fea-9a79-03d07de6c750 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:12.421956 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f2fd57d9-4fe4-4ddb-aa24-766efebd516b req-4d13051f-9877-4fea-9a79-03d07de6c750 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:12.436053 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-f2fd57d9-4fe4-4ddb-aa24-766efebd516b req-4d13051f-9877-4fea-9a79-03d07de6c750 service nova] Creating event network-changed:22b9f953-2c86-4d1f-ac22-5abc810169c7 for instance 91a2054d-de32-402c-8f6a-2f753925164d on hv-cinder-84213 May 26 20:25:12.444974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-f2fd57d9-4fe4-4ddb-aa24-766efebd516b req-4d13051f-9877-4fea-9a79-03d07de6c750 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040368 May 26 20:25:12.445942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 106/216] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:12.646115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-f6144e85-2baa-408f-a1b3-454b41277a00 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:12.647508 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-f6144e85-2baa-408f-a1b3-454b41277a00 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:12.664950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f6144e85-2baa-408f-a1b3-454b41277a00 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:12.665756 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f6144e85-2baa-408f-a1b3-454b41277a00 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:12.666767 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f6144e85-2baa-408f-a1b3-454b41277a00 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:12.667463 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f6144e85-2baa-408f-a1b3-454b41277a00 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:12.693359 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:12.826259 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-667269a7-e778-4f7d-bd08-71bab2cc7b75 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:12.827065 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-667269a7-e778-4f7d-bd08-71bab2cc7b75 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:12.829401 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-f6144e85-2baa-408f-a1b3-454b41277a00 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:12.838017 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-f6144e85-2baa-408f-a1b3-454b41277a00 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1464 microversion: 2.1 time: 0.206239 May 26 20:25:12.850384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 111/217] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:12 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1464 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:12.851014 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-667269a7-e778-4f7d-bd08-71bab2cc7b75 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:12.851014 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-667269a7-e778-4f7d-bd08-71bab2cc7b75 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:12.851014 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-667269a7-e778-4f7d-bd08-71bab2cc7b75 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:12.851014 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-667269a7-e778-4f7d-bd08-71bab2cc7b75 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:12.891089 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-3f89ca69-bdc1-4b47-a6e7-fe0d01b3779b tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:12.891617 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3f89ca69-bdc1-4b47-a6e7-fe0d01b3779b tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:12.898381 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3f89ca69-bdc1-4b47-a6e7-fe0d01b3779b tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:12.898803 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3f89ca69-bdc1-4b47-a6e7-fe0d01b3779b tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:12.899791 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3f89ca69-bdc1-4b47-a6e7-fe0d01b3779b tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:12.900248 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3f89ca69-bdc1-4b47-a6e7-fe0d01b3779b tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:12.935841 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3f89ca69-bdc1-4b47-a6e7-fe0d01b3779b tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Going to try to terminate instance {{(pid=118306) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:25:13.077428 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-667269a7-e778-4f7d-bd08-71bab2cc7b75 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:13.085651 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-667269a7-e778-4f7d-bd08-71bab2cc7b75 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.265340 May 26 20:25:13.096656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 107/218] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:12 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:13.103660 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-20e32d6c-ba4c-4d1a-bd33-0a8ba88774fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:13.104279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-20e32d6c-ba4c-4d1a-bd33-0a8ba88774fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:13.111732 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e32d6c-ba4c-4d1a-bd33-0a8ba88774fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:13.112448 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e32d6c-ba4c-4d1a-bd33-0a8ba88774fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:13.113841 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e32d6c-ba4c-4d1a-bd33-0a8ba88774fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:13.113982 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e32d6c-ba4c-4d1a-bd33-0a8ba88774fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:13.237131 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-3f89ca69-bdc1-4b47-a6e7-fe0d01b3779b tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 204 len: 0 microversion: 2.1 time: 0.351483 May 26 20:25:13.243149 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 112/219] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:25:12 2022] DELETE /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:25:13.249492 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-605c391b-2e81-42c1-a668-4a7044cd7169 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:13.250563 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-605c391b-2e81-42c1-a668-4a7044cd7169 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:13.257413 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-605c391b-2e81-42c1-a668-4a7044cd7169 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:13.258312 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-605c391b-2e81-42c1-a668-4a7044cd7169 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:13.260209 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-605c391b-2e81-42c1-a668-4a7044cd7169 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:13.260638 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-605c391b-2e81-42c1-a668-4a7044cd7169 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:13.330903 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-20e32d6c-ba4c-4d1a-bd33-0a8ba88774fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:13.338605 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-20e32d6c-ba4c-4d1a-bd33-0a8ba88774fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1366 microversion: 2.1 time: 0.240418 May 26 20:25:13.339180 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 108/220] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:13 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:13.406681 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-605c391b-2e81-42c1-a668-4a7044cd7169 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:13.414221 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-605c391b-2e81-42c1-a668-4a7044cd7169 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1470 microversion: 2.1 time: 0.169654 May 26 20:25:13.415143 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 113/221] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:13 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:14.103452 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5191e539-54ec-45bd-b518-7f9c99aae305 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:14.104057 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5191e539-54ec-45bd-b518-7f9c99aae305 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:14.111768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5191e539-54ec-45bd-b518-7f9c99aae305 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:14.112390 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5191e539-54ec-45bd-b518-7f9c99aae305 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:14.113162 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5191e539-54ec-45bd-b518-7f9c99aae305 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:14.113653 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5191e539-54ec-45bd-b518-7f9c99aae305 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:14.117797 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:14.320988 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5191e539-54ec-45bd-b518-7f9c99aae305 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:14.358380 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-27a18f41-a3e5-4134-a427-42aa3d51e544 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:14.360720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-27a18f41-a3e5-4134-a427-42aa3d51e544 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:14.360829 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5191e539-54ec-45bd-b518-7f9c99aae305 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.259854 May 26 20:25:14.364860 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 109/222] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:14 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:14.369628 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-27a18f41-a3e5-4134-a427-42aa3d51e544 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:14.370091 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-27a18f41-a3e5-4134-a427-42aa3d51e544 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:14.370951 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-27a18f41-a3e5-4134-a427-42aa3d51e544 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:14.371397 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-27a18f41-a3e5-4134-a427-42aa3d51e544 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:14.433419 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d744e277-c12e-4ed1-8a0d-c06043e78986 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:14.434287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d744e277-c12e-4ed1-8a0d-c06043e78986 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:14.441444 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d744e277-c12e-4ed1-8a0d-c06043e78986 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:14.444493 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d744e277-c12e-4ed1-8a0d-c06043e78986 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:14.444493 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d744e277-c12e-4ed1-8a0d-c06043e78986 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:14.444493 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d744e277-c12e-4ed1-8a0d-c06043e78986 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:14.575920 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-27a18f41-a3e5-4134-a427-42aa3d51e544 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:14.585418 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-27a18f41-a3e5-4134-a427-42aa3d51e544 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1366 microversion: 2.1 time: 0.230663 May 26 20:25:14.585418 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 114/223] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:14 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:14.712646 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-d744e277-c12e-4ed1-8a0d-c06043e78986 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:14.723125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d744e277-c12e-4ed1-8a0d-c06043e78986 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1470 microversion: 2.1 time: 0.293506 May 26 20:25:14.724036 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 110/224] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:14 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1470 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:15.377757 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-fdd09c9b-c17d-4dd2-bd91-e66fedf82bc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:15.378349 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-fdd09c9b-c17d-4dd2-bd91-e66fedf82bc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:15.385311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fdd09c9b-c17d-4dd2-bd91-e66fedf82bc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:15.385835 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fdd09c9b-c17d-4dd2-bd91-e66fedf82bc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:15.386819 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fdd09c9b-c17d-4dd2-bd91-e66fedf82bc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:15.387292 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fdd09c9b-c17d-4dd2-bd91-e66fedf82bc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:15.525542 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-fdd09c9b-c17d-4dd2-bd91-e66fedf82bc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:15.533820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-fdd09c9b-c17d-4dd2-bd91-e66fedf82bc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.161775 May 26 20:25:15.538500 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 115/225] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:15 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:15.602622 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ecddf5b6-e68e-4b1f-b6e5-e6969feb9bde tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:15.603312 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ecddf5b6-e68e-4b1f-b6e5-e6969feb9bde tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:15.610953 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ecddf5b6-e68e-4b1f-b6e5-e6969feb9bde tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:15.611409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ecddf5b6-e68e-4b1f-b6e5-e6969feb9bde tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:15.612187 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ecddf5b6-e68e-4b1f-b6e5-e6969feb9bde tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:15.612661 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ecddf5b6-e68e-4b1f-b6e5-e6969feb9bde tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:15.740823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4121c768-3b31-4778-aaa0-356a603508b6 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:15.742323 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4121c768-3b31-4778-aaa0-356a603508b6 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:15.750531 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4121c768-3b31-4778-aaa0-356a603508b6 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:15.751082 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4121c768-3b31-4778-aaa0-356a603508b6 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:15.751917 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4121c768-3b31-4778-aaa0-356a603508b6 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:15.752404 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4121c768-3b31-4778-aaa0-356a603508b6 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:15.872012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ecddf5b6-e68e-4b1f-b6e5-e6969feb9bde tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:15.883129 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ecddf5b6-e68e-4b1f-b6e5-e6969feb9bde tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1366 microversion: 2.1 time: 0.284526 May 26 20:25:15.893299 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 111/226] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:15 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:15.915311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4121c768-3b31-4778-aaa0-356a603508b6 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:15.926122 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4121c768-3b31-4778-aaa0-356a603508b6 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1470 microversion: 2.1 time: 0.189218 May 26 20:25:15.927185 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 116/227] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:15 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:16.433066 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-c4f17bdc-14bd-46a0-9bd1-df04c095df2b req-3b3e6b22-f229-4d06-8f2a-c1c5147105aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e", "name": "network-vif-deleted", "tag": "feaad53b-7798-4b0e-8e7e-6de0edb3d3b8"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:16.448619 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-c4f17bdc-14bd-46a0-9bd1-df04c095df2b req-3b3e6b22-f229-4d06-8f2a-c1c5147105aa service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:16.449072 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-c4f17bdc-14bd-46a0-9bd1-df04c095df2b req-3b3e6b22-f229-4d06-8f2a-c1c5147105aa service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:16.479310 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-c4f17bdc-14bd-46a0-9bd1-df04c095df2b req-3b3e6b22-f229-4d06-8f2a-c1c5147105aa service nova] Creating event network-vif-deleted:feaad53b-7798-4b0e-8e7e-6de0edb3d3b8 for instance 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e on hv-cinder-84213 May 26 20:25:16.491892 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-c4f17bdc-14bd-46a0-9bd1-df04c095df2b req-3b3e6b22-f229-4d06-8f2a-c1c5147105aa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062398 May 26 20:25:16.496740 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 112/228] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:16.551055 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6b7e14fe-3bfd-45d0-9928-331ed45c9cfe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:16.551771 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6b7e14fe-3bfd-45d0-9928-331ed45c9cfe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:16.561563 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6b7e14fe-3bfd-45d0-9928-331ed45c9cfe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:16.562223 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6b7e14fe-3bfd-45d0-9928-331ed45c9cfe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:16.563394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6b7e14fe-3bfd-45d0-9928-331ed45c9cfe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:16.563995 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6b7e14fe-3bfd-45d0-9928-331ed45c9cfe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:16.712848 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6b7e14fe-3bfd-45d0-9928-331ed45c9cfe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:16.722934 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6b7e14fe-3bfd-45d0-9928-331ed45c9cfe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.176167 May 26 20:25:16.728161 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 117/229] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:16 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:16.917583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ce58f9cd-edee-472e-9d29-1bcecd533695 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:16.918029 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ce58f9cd-edee-472e-9d29-1bcecd533695 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:16.928970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ce58f9cd-edee-472e-9d29-1bcecd533695 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:16.929502 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ce58f9cd-edee-472e-9d29-1bcecd533695 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:16.930587 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ce58f9cd-edee-472e-9d29-1bcecd533695 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:16.931253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ce58f9cd-edee-472e-9d29-1bcecd533695 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:16.951311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-083e9210-1b2a-4a04-bf0f-dbff315c2c07 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:16.964383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-083e9210-1b2a-4a04-bf0f-dbff315c2c07 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:16.979276 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-083e9210-1b2a-4a04-bf0f-dbff315c2c07 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:16.979786 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-083e9210-1b2a-4a04-bf0f-dbff315c2c07 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:16.982039 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-083e9210-1b2a-4a04-bf0f-dbff315c2c07 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:16.982596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-083e9210-1b2a-4a04-bf0f-dbff315c2c07 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:17.026229 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-083e9210-1b2a-4a04-bf0f-dbff315c2c07 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:17.026828 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-083e9210-1b2a-4a04-bf0f-dbff315c2c07 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:17.027337 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-083e9210-1b2a-4a04-bf0f-dbff315c2c07 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lazy-loading 'fault' on Instance uuid 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:25:17.093286 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-083e9210-1b2a-4a04-bf0f-dbff315c2c07 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad08fb22e1a0432eb8d09389cdfb17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb014814b18450381628161307a56d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:17.120621 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:17.126697 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-083e9210-1b2a-4a04-bf0f-dbff315c2c07 tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 200 len: 1304 microversion: 2.1 time: 0.185901 May 26 20:25:17.127183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 118/230] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:16 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:17.159806 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ce58f9cd-edee-472e-9d29-1bcecd533695 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:17.170995 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ce58f9cd-edee-472e-9d29-1bcecd533695 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1366 microversion: 2.1 time: 0.265444 May 26 20:25:17.180897 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 113/231] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:16 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:17.740673 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-97e6c03f-0bc3-4cf3-9a85-ed35a4c3b9e9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:17.741292 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-97e6c03f-0bc3-4cf3-9a85-ed35a4c3b9e9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:17.747642 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-97e6c03f-0bc3-4cf3-9a85-ed35a4c3b9e9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:17.748094 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-97e6c03f-0bc3-4cf3-9a85-ed35a4c3b9e9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:17.750058 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-97e6c03f-0bc3-4cf3-9a85-ed35a4c3b9e9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:17.750526 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-97e6c03f-0bc3-4cf3-9a85-ed35a4c3b9e9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:17.881251 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2ad90567-7653-4a6f-b935-5fbb710bede9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:17.885487 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2ad90567-7653-4a6f-b935-5fbb710bede9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:17.885487 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:17.897414 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ad90567-7653-4a6f-b935-5fbb710bede9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:17.906862 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ad90567-7653-4a6f-b935-5fbb710bede9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:17.907742 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ad90567-7653-4a6f-b935-5fbb710bede9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:17.908195 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2ad90567-7653-4a6f-b935-5fbb710bede9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:17.945669 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2ad90567-7653-4a6f-b935-5fbb710bede9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/ips" status: 200 len: 146 microversion: 2.1 time: 0.068613 May 26 20:25:17.952744 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 114/232] 10.222.0.44 () {58 vars in 1247 bytes} [Thu May 26 20:25:17 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/ips => generated 146 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:17.979596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-97e6c03f-0bc3-4cf3-9a85-ed35a4c3b9e9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:17.988503 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-97e6c03f-0bc3-4cf3-9a85-ed35a4c3b9e9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.251950 May 26 20:25:17.989080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 119/233] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:17 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:18.144433 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fe103c52-fc21-4c1d-b9af-fe9d49e8322c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:18.149615 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fe103c52-fc21-4c1d-b9af-fe9d49e8322c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] [instance: 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:18.153341 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe103c52-fc21-4c1d-b9af-fe9d49e8322c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:18.154016 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe103c52-fc21-4c1d-b9af-fe9d49e8322c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:18.155020 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe103c52-fc21-4c1d-b9af-fe9d49e8322c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:18.155595 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe103c52-fc21-4c1d-b9af-fe9d49e8322c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:18.171715 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-fe103c52-fc21-4c1d-b9af-fe9d49e8322c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] HTTP exception thrown: Instance 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e could not be found. May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fe103c52-fc21-4c1d-b9af-fe9d49e8322c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Request method failure captured: May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e HTTP/1.1 May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-IP0n80Qe1FftufCSk4DnwubN4F4OEMcF3QUJzg_h3cdkEiH1O-APKRp18262o4RZO1Db5Q1eNkVlFOCsj5_sJBFGSdYQw4BvCOkIsUQt0wY2wuf3Q1ZhMV8HVtkGYkPLmDNmLngXu0Jk4W3RrVAnzBH-QXnpxKZn3B4mc8zarqzUw May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: bcb014814b18450381628161307a56d5 May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesNegativeTest-168770785 May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:25:18.173635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:25:18.175064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bcb014814b18450381628161307a56d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcb014814b18450381628161307a56d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bcb014814b18450381628161307a56d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcb014814b18450381628161307a56d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:25:18.175064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-VolumesNegativeTest-168770785 May 26 20:25:18.175064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: bcb014814b18450381628161307a56d5 May 26 20:25:18.175064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesNegativeTest-168770785 May 26 20:25:18.175064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-VolumesNegativeTest-168770785-project May 26 20:25:18.175064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:25:18.175064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:25:18.175064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: ad08fb22e1a0432eb8d09389cdfb17d4 May 26 20:25:18.175064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-VolumesNegativeTest-168770785-project May 26 20:25:18.175064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:25:18.175064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e could not be found. May 26 20:25:18.175064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e'} May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e could not be found. May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:25:18.175936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e could not be found. May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e could not be found. May 26 20:25:18.177360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:25:18.180460 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fe103c52-fc21-4c1d-b9af-fe9d49e8322c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] Returning 404 to user: Instance 6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:25:18.180460 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fe103c52-fc21-4c1d-b9af-fe9d49e8322c tempest-VolumesNegativeTest-168770785 tempest-VolumesNegativeTest-168770785-project] 10.222.0.44 "GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e" status: 404 len: 111 microversion: 2.1 time: 0.040424 May 26 20:25:18.182713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 115/234] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:18 2022] GET /compute/v2.1/servers/6e9e3ddb-23b3-4072-8c49-1f00f5a9c80e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:25:18.190092 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e0ae155f-e230-41b1-a0c3-8c994afe29d1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:18.191067 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e0ae155f-e230-41b1-a0c3-8c994afe29d1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:18.202575 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e0ae155f-e230-41b1-a0c3-8c994afe29d1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:18.203529 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e0ae155f-e230-41b1-a0c3-8c994afe29d1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:18.207048 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e0ae155f-e230-41b1-a0c3-8c994afe29d1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:18.207704 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e0ae155f-e230-41b1-a0c3-8c994afe29d1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:18.403876 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e0ae155f-e230-41b1-a0c3-8c994afe29d1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:18.418969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e0ae155f-e230-41b1-a0c3-8c994afe29d1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1366 microversion: 2.1 time: 0.233934 May 26 20:25:18.427073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 120/235] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:18 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:19.012218 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cff70570-0243-443b-aa23-432123a656ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:19.015518 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cff70570-0243-443b-aa23-432123a656ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:19.037183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cff70570-0243-443b-aa23-432123a656ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:19.037635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cff70570-0243-443b-aa23-432123a656ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:19.038589 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cff70570-0243-443b-aa23-432123a656ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:19.038873 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cff70570-0243-443b-aa23-432123a656ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:19.197279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cff70570-0243-443b-aa23-432123a656ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:19.206037 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cff70570-0243-443b-aa23-432123a656ec tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.204673 May 26 20:25:19.207191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 116/236] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:19 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:19.442161 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7147965d-2dd5-4802-a592-8616dacd07bf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:19.443119 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7147965d-2dd5-4802-a592-8616dacd07bf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:19.445234 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=16 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:19.456249 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7147965d-2dd5-4802-a592-8616dacd07bf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:19.456249 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7147965d-2dd5-4802-a592-8616dacd07bf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:19.456249 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7147965d-2dd5-4802-a592-8616dacd07bf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:19.456249 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7147965d-2dd5-4802-a592-8616dacd07bf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:19.680930 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7147965d-2dd5-4802-a592-8616dacd07bf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:19.688876 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7147965d-2dd5-4802-a592-8616dacd07bf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1366 microversion: 2.1 time: 0.253372 May 26 20:25:19.692379 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 121/237] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:19 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:20.167862 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-a2ff1a47-71f5-46b4-859d-07cf90bc3908 req-9eedccd3-a919-4ff7-b6d2-44737c723584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a2054d-de32-402c-8f6a-2f753925164d", "name": "network-vif-plugged", "status": "completed", "tag": "22b9f953-2c86-4d1f-ac22-5abc810169c7"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:20.176530 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-a2ff1a47-71f5-46b4-859d-07cf90bc3908 req-9eedccd3-a919-4ff7-b6d2-44737c723584 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:20.177151 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-a2ff1a47-71f5-46b4-859d-07cf90bc3908 req-9eedccd3-a919-4ff7-b6d2-44737c723584 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:20.190490 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-a2ff1a47-71f5-46b4-859d-07cf90bc3908 req-9eedccd3-a919-4ff7-b6d2-44737c723584 service nova] Creating event network-vif-plugged:22b9f953-2c86-4d1f-ac22-5abc810169c7 for instance 91a2054d-de32-402c-8f6a-2f753925164d on hv-cinder-84213 May 26 20:25:20.195873 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-a2ff1a47-71f5-46b4-859d-07cf90bc3908 req-9eedccd3-a919-4ff7-b6d2-44737c723584 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034252 May 26 20:25:20.196690 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 117/238] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:20.237111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-3808c391-daff-4d01-a6bb-6c25b44bfb68 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:20.237729 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3808c391-daff-4d01-a6bb-6c25b44bfb68 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:20.259232 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3808c391-daff-4d01-a6bb-6c25b44bfb68 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:20.265858 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3808c391-daff-4d01-a6bb-6c25b44bfb68 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:20.267886 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3808c391-daff-4d01-a6bb-6c25b44bfb68 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:20.270381 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3808c391-daff-4d01-a6bb-6c25b44bfb68 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:20.610006 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-3808c391-daff-4d01-a6bb-6c25b44bfb68 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:20.635557 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-3808c391-daff-4d01-a6bb-6c25b44bfb68 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.408994 May 26 20:25:20.646023 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 122/239] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:20 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:20.714398 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-20af7d61-04e3-4897-845f-067b91195dc0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:20.714398 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-20af7d61-04e3-4897-845f-067b91195dc0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:20.714398 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20af7d61-04e3-4897-845f-067b91195dc0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:20.714398 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20af7d61-04e3-4897-845f-067b91195dc0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:20.714861 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20af7d61-04e3-4897-845f-067b91195dc0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:20.715067 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20af7d61-04e3-4897-845f-067b91195dc0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:20.924507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-20af7d61-04e3-4897-845f-067b91195dc0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:20.930546 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-20af7d61-04e3-4897-845f-067b91195dc0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1366 microversion: 2.1 time: 0.228714 May 26 20:25:20.931151 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 118/240] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:20 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:21.085324 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-79a2f242-3ad6-4c64-a2d4-25570099e5fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b530df0-4e12-48a7-8470-573a0288b532"}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:21.086892 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-79a2f242-3ad6-4c64-a2d4-25570099e5fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:21.095261 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-79a2f242-3ad6-4c64-a2d4-25570099e5fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:21.096143 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-79a2f242-3ad6-4c64-a2d4-25570099e5fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:21.097134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-79a2f242-3ad6-4c64-a2d4-25570099e5fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:21.097762 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-79a2f242-3ad6-4c64-a2d4-25570099e5fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:21.655711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5a84ece9-3ab9-441d-855a-146a0a15362a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:21.656495 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5a84ece9-3ab9-441d-855a-146a0a15362a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:21.666111 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a84ece9-3ab9-441d-855a-146a0a15362a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:21.667673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a84ece9-3ab9-441d-855a-146a0a15362a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:21.669403 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a84ece9-3ab9-441d-855a-146a0a15362a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:21.670176 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a84ece9-3ab9-441d-855a-146a0a15362a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:22.142773 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5a84ece9-3ab9-441d-855a-146a0a15362a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:22.154654 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5a84ece9-3ab9-441d-855a-146a0a15362a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.501432 May 26 20:25:22.154654 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 119/241] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:21 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:22.167445 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7d2352ea-cefc-412d-8f78-799bb4319b31 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:22.168079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7d2352ea-cefc-412d-8f78-799bb4319b31 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:22.183962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-79a2f242-3ad6-4c64-a2d4-25570099e5fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "POST /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.102334 May 26 20:25:22.186077 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 123/242] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:25:21 2022] POST /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/os-volume_attachments => generated 194 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:22.191556 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d2352ea-cefc-412d-8f78-799bb4319b31 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:22.191556 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d2352ea-cefc-412d-8f78-799bb4319b31 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:22.191556 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d2352ea-cefc-412d-8f78-799bb4319b31 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:22.191556 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d2352ea-cefc-412d-8f78-799bb4319b31 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:22.484477 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7d2352ea-cefc-412d-8f78-799bb4319b31 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:22.509419 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7d2352ea-cefc-412d-8f78-799bb4319b31 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1366 microversion: 2.1 time: 0.355389 May 26 20:25:22.511940 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 120/243] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:22 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:23.171459 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-de00b240-870e-427b-a782-35f629601e67 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:23.172343 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-de00b240-870e-427b-a782-35f629601e67 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:23.178805 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-de00b240-870e-427b-a782-35f629601e67 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:23.179339 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-de00b240-870e-427b-a782-35f629601e67 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:23.187174 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-de00b240-870e-427b-a782-35f629601e67 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:23.187174 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-de00b240-870e-427b-a782-35f629601e67 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:23.346983 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-de00b240-870e-427b-a782-35f629601e67 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:23.356367 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:23.364044 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-de00b240-870e-427b-a782-35f629601e67 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.198673 May 26 20:25:23.378965 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 124/244] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:23 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:23.528863 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5a403d02-c930-4186-bd46-d9327c9ae6de tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:23.529489 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5a403d02-c930-4186-bd46-d9327c9ae6de tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:23.535591 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a403d02-c930-4186-bd46-d9327c9ae6de tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:23.536088 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a403d02-c930-4186-bd46-d9327c9ae6de tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:23.536847 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a403d02-c930-4186-bd46-d9327c9ae6de tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:23.537277 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a403d02-c930-4186-bd46-d9327c9ae6de tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:23.737852 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5a403d02-c930-4186-bd46-d9327c9ae6de tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:23.742845 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5a403d02-c930-4186-bd46-d9327c9ae6de tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1555 microversion: 2.1 time: 0.217829 May 26 20:25:23.743424 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 121/245] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:23 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:23.761622 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-98fd521d-4ce7-4fe6-ab57-0e5c905bdf8f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:23.762141 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-98fd521d-4ce7-4fe6-ab57-0e5c905bdf8f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:23.769626 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-98fd521d-4ce7-4fe6-ab57-0e5c905bdf8f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:23.770263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-98fd521d-4ce7-4fe6-ab57-0e5c905bdf8f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:23.771240 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-98fd521d-4ce7-4fe6-ab57-0e5c905bdf8f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:23.771670 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-98fd521d-4ce7-4fe6-ab57-0e5c905bdf8f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:23.858022 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-98fd521d-4ce7-4fe6-ab57-0e5c905bdf8f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100829 May 26 20:25:23.860086 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 125/246] 10.222.0.44 () {58 vars in 1274 bytes} [Thu May 26 20:25:23 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:24.385592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1590f7f4-9353-4325-97a7-58477fc03905 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:24.386201 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1590f7f4-9353-4325-97a7-58477fc03905 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:24.398585 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1590f7f4-9353-4325-97a7-58477fc03905 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:24.399104 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1590f7f4-9353-4325-97a7-58477fc03905 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:24.401634 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1590f7f4-9353-4325-97a7-58477fc03905 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:24.402073 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1590f7f4-9353-4325-97a7-58477fc03905 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:24.680679 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-1590f7f4-9353-4325-97a7-58477fc03905 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:24.698762 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1590f7f4-9353-4325-97a7-58477fc03905 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.316911 May 26 20:25:24.699301 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 122/247] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:24 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:25.447588 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-926a74f5-99d9-421d-b23a-62a8dfb4869c req-60683a49-bd86-4ed6-ae45-551195dac6fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a2054d-de32-402c-8f6a-2f753925164d", "tag": "22b9f953-2c86-4d1f-ac22-5abc810169c7"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:25.460410 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-926a74f5-99d9-421d-b23a-62a8dfb4869c req-60683a49-bd86-4ed6-ae45-551195dac6fc service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:25.461108 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-926a74f5-99d9-421d-b23a-62a8dfb4869c req-60683a49-bd86-4ed6-ae45-551195dac6fc service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:25.477858 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-926a74f5-99d9-421d-b23a-62a8dfb4869c req-60683a49-bd86-4ed6-ae45-551195dac6fc service nova] Creating event network-changed:22b9f953-2c86-4d1f-ac22-5abc810169c7 for instance 91a2054d-de32-402c-8f6a-2f753925164d on hv-cinder-84213 May 26 20:25:25.485513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-926a74f5-99d9-421d-b23a-62a8dfb4869c req-60683a49-bd86-4ed6-ae45-551195dac6fc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040877 May 26 20:25:25.487936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 126/248] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:25:25.719742 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-35312420-dd29-45b6-a56f-ccf8fb9ac8d3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:25.720419 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-35312420-dd29-45b6-a56f-ccf8fb9ac8d3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:25.730808 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-35312420-dd29-45b6-a56f-ccf8fb9ac8d3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:25.738904 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-35312420-dd29-45b6-a56f-ccf8fb9ac8d3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:25.738904 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-35312420-dd29-45b6-a56f-ccf8fb9ac8d3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:25.738904 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-35312420-dd29-45b6-a56f-ccf8fb9ac8d3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:26.039081 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-35312420-dd29-45b6-a56f-ccf8fb9ac8d3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:26.048301 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-35312420-dd29-45b6-a56f-ccf8fb9ac8d3 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1502 microversion: 2.1 time: 0.335849 May 26 20:25:26.049091 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 123/249] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:25 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1502 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:26.067608 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8af98f09-e81b-4168-877e-5db4298ead99 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a8cf186-bf60-426c-92ce-6cbcda514d08"}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:26.068992 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8af98f09-e81b-4168-877e-5db4298ead99 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:26.078555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8af98f09-e81b-4168-877e-5db4298ead99 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:26.085965 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8af98f09-e81b-4168-877e-5db4298ead99 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:26.085965 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8af98f09-e81b-4168-877e-5db4298ead99 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:26.085965 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8af98f09-e81b-4168-877e-5db4298ead99 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:26.138150 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-8af98f09-e81b-4168-877e-5db4298ead99 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] HTTP exception thrown: Cannot 'attach_volume' instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab while it is in vm_state rescued May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8af98f09-e81b-4168-877e-5db4298ead99 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Request method failure captured: May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: POST /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab/os-volume_attachments HTTP/1.1 May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 74 May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-HMctYnQef_fAFPqfLUdEsnXRp3PwFjMEZRaQa7XPlJWn0X3l7DHadWcb2y0MoBJ1Hg8jC9EJQtLjfc-f0GM-q2csWz-teo7cHIAXDxZzA1vXKbu_xP23ZMRI-6Dd4cd3BeN3sMIbgVw_F3vNl2TJ_XqOLmKvEG7iH0NVNfQM8lyCE May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: f6160118ba95403e8df08ac74982954d May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:25:26.141076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:25:26.142470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f6160118ba95403e8df08ac74982954d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6160118ba95403e8df08ac74982954d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f6160118ba95403e8df08ac74982954d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6160118ba95403e8df08ac74982954d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:25:26.142470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:25:26.142470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: f6160118ba95403e8df08ac74982954d May 26 20:25:26.142470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:25:26.142470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-ServerRescueNegativeTestJSON-1606344399-project May 26 20:25:26.142470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:25:26.142470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:25:26.142470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: 146a7d1f40854f859864d463f403178f May 26 20:25:26.142470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606344399-project May 26 20:25:26.142470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: May 26 20:25:26.142470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {"volumeAttachment": {"volumeId": "3a8cf186-bf60-426c-92ce-6cbcda514d08"}} May 26 20:25:26.142470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Cannot 'attach_volume' instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab while it is in vm_state rescued May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'server_id': '1f23bb01-825e-4dcf-a2a0-e75b6c8928ab', 'body': {'volumeAttachment': {'volumeId': '3a8cf186-bf60-426c-92ce-6cbcda514d08'}}} May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:25:26.143454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab while it is in vm_state rescued May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:25:26.144633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:25:26.145855 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:25:26.145855 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:25:26.145855 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab while it is in vm_state rescued May 26 20:25:26.145855 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:25:26.148299 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8af98f09-e81b-4168-877e-5db4298ead99 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Returning 409 to user: Cannot 'attach_volume' instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab while it is in vm_state rescued {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:25:26.149959 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8af98f09-e81b-4168-877e-5db4298ead99 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "POST /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.087046 May 26 20:25:26.158135 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 127/250] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:25:26 2022] POST /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab/os-volume_attachments => generated 152 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 26 20:25:26.172514 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5cc86e6b-bdf9-4183-88e9-d463ef6e4bd4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:26.173398 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5cc86e6b-bdf9-4183-88e9-d463ef6e4bd4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:26.182886 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5cc86e6b-bdf9-4183-88e9-d463ef6e4bd4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:26.183496 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5cc86e6b-bdf9-4183-88e9-d463ef6e4bd4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:26.189290 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5cc86e6b-bdf9-4183-88e9-d463ef6e4bd4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:26.189290 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5cc86e6b-bdf9-4183-88e9-d463ef6e4bd4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:26.539369 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5cc86e6b-bdf9-4183-88e9-d463ef6e4bd4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "POST /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab/action" status: 202 len: 0 microversion: 2.1 time: 0.377518 May 26 20:25:26.549945 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-fb76e069-3846-4c0a-b925-9e8d7391a0e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:26.551200 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-fb76e069-3846-4c0a-b925-9e8d7391a0e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:26.559332 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 124/251] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:25:26 2022] POST /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:25:26.565996 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fb76e069-3846-4c0a-b925-9e8d7391a0e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:26.566856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fb76e069-3846-4c0a-b925-9e8d7391a0e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:26.567876 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fb76e069-3846-4c0a-b925-9e8d7391a0e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:26.568591 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fb76e069-3846-4c0a-b925-9e8d7391a0e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:26.804575 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-fb76e069-3846-4c0a-b925-9e8d7391a0e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:26.819224 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-fb76e069-3846-4c0a-b925-9e8d7391a0e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1510 microversion: 2.1 time: 0.271969 May 26 20:25:26.820906 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 128/252] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:26 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1510 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:27.851092 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-351e7073-658b-40f2-83c7-6cea1243fe91 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:27.851092 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-351e7073-658b-40f2-83c7-6cea1243fe91 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:27.855804 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-351e7073-658b-40f2-83c7-6cea1243fe91 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:27.856293 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-351e7073-658b-40f2-83c7-6cea1243fe91 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:27.857213 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-351e7073-658b-40f2-83c7-6cea1243fe91 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:27.857794 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-351e7073-658b-40f2-83c7-6cea1243fe91 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:28.030362 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-351e7073-658b-40f2-83c7-6cea1243fe91 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:28.038661 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-351e7073-658b-40f2-83c7-6cea1243fe91 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1510 microversion: 2.1 time: 0.196407 May 26 20:25:28.058839 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 125/253] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:27 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:29.067356 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-775a7d5f-a19c-4d0e-8bc6-fa5cc76586e1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:29.068852 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-775a7d5f-a19c-4d0e-8bc6-fa5cc76586e1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:29.076804 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-775a7d5f-a19c-4d0e-8bc6-fa5cc76586e1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:29.077503 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-775a7d5f-a19c-4d0e-8bc6-fa5cc76586e1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:29.078616 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-775a7d5f-a19c-4d0e-8bc6-fa5cc76586e1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:29.079291 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-775a7d5f-a19c-4d0e-8bc6-fa5cc76586e1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:29.228201 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-775a7d5f-a19c-4d0e-8bc6-fa5cc76586e1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:29.236664 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-775a7d5f-a19c-4d0e-8bc6-fa5cc76586e1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1510 microversion: 2.1 time: 0.173366 May 26 20:25:29.237468 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 129/254] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:29 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:29.362995 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1252140941", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "networks": [{"uuid": "2a782230-6255-4dbb-88c7-2bfd62746d19"}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:29.422975 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] validate_networks() for [('2a782230-6255-4dbb-88c7-2bfd62746d19', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:25:29.790690 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:25:29.791109 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:25:29.791609 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:25:29.792577 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:25:29.793060 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:25:29.803820 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:29.804261 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:29.805169 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:29.810431 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:29.825899 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Getting quotas for project c7deb3c965bb427eb4a9753cd21bca05. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:25:29.833210 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Getting quotas for user d005cfcbb5e04a1084857e89a42921f9 and project c7deb3c965bb427eb4a9753cd21bca05. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:25:29.843236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:25:29.845086 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:25:30.013445 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cba76747-5f87-4c35-8cc3-f6c8164d2ff0 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655767 May 26 20:25:30.014112 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 126/255] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:25:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:25:30.026303 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-99c06563-4877-4493-b4da-c664cda515b8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:30.027362 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-99c06563-4877-4493-b4da-c664cda515b8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:30.033250 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:30.083753 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-99c06563-4877-4493-b4da-c664cda515b8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:30.095448 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-99c06563-4877-4493-b4da-c664cda515b8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1219 microversion: 2.1 time: 0.073091 May 26 20:25:30.096619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 130/256] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:30 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:30.255987 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fb8241a3-6581-4a92-a550-42cb9f6ea13e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:30.256657 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fb8241a3-6581-4a92-a550-42cb9f6ea13e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:30.270793 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb8241a3-6581-4a92-a550-42cb9f6ea13e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:30.270793 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb8241a3-6581-4a92-a550-42cb9f6ea13e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:30.270793 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb8241a3-6581-4a92-a550-42cb9f6ea13e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:30.270793 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fb8241a3-6581-4a92-a550-42cb9f6ea13e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:30.412774 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-fb8241a3-6581-4a92-a550-42cb9f6ea13e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:30.415279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:30.421452 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fb8241a3-6581-4a92-a550-42cb9f6ea13e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1516 microversion: 2.1 time: 0.169510 May 26 20:25:30.422025 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 127/257] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:30 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:31.113364 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-32744433-996d-4710-ad24-8e7dff0c7e1a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:31.114147 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-32744433-996d-4710-ad24-8e7dff0c7e1a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:31.178658 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-32744433-996d-4710-ad24-8e7dff0c7e1a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:31.192868 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-32744433-996d-4710-ad24-8e7dff0c7e1a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1219 microversion: 2.1 time: 0.083608 May 26 20:25:31.193615 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 131/258] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:31 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:31.788268 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e4324a8e-20da-4054-a9a3-98cbda1e5a2d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:31.795142 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4324a8e-20da-4054-a9a3-98cbda1e5a2d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:31.796274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e4324a8e-20da-4054-a9a3-98cbda1e5a2d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:31.864923 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e4324a8e-20da-4054-a9a3-98cbda1e5a2d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Going to try to stop instance {{(pid=118307) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 20:25:32.016550 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e4324a8e-20da-4054-a9a3-98cbda1e5a2d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "POST /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/action" status: 202 len: 0 microversion: 2.1 time: 0.232085 May 26 20:25:32.017421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 128/259] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:25:31 2022] POST /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:25:32.025979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2c5e640d-794f-4cff-bfc1-1d9c75b97bfc tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:32.026635 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2c5e640d-794f-4cff-bfc1-1d9c75b97bfc tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:32.034306 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2c5e640d-794f-4cff-bfc1-1d9c75b97bfc tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:32.034754 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2c5e640d-794f-4cff-bfc1-1d9c75b97bfc tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:32.035517 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2c5e640d-794f-4cff-bfc1-1d9c75b97bfc tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:32.035949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2c5e640d-794f-4cff-bfc1-1d9c75b97bfc tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:32.178443 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2c5e640d-794f-4cff-bfc1-1d9c75b97bfc tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:32.189391 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2c5e640d-794f-4cff-bfc1-1d9c75b97bfc tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.167356 May 26 20:25:32.189977 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 132/260] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:32 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:32.209874 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1255b8d0-3104-4675-8c54-1a9deac331cb tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:32.210607 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1255b8d0-3104-4675-8c54-1a9deac331cb tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:32.218780 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1255b8d0-3104-4675-8c54-1a9deac331cb tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:32.219413 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1255b8d0-3104-4675-8c54-1a9deac331cb tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:32.220198 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1255b8d0-3104-4675-8c54-1a9deac331cb tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:32.220696 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1255b8d0-3104-4675-8c54-1a9deac331cb tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:32.288988 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-1255b8d0-3104-4675-8c54-1a9deac331cb tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:32.297083 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1255b8d0-3104-4675-8c54-1a9deac331cb tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1271 microversion: 2.1 time: 0.091352 May 26 20:25:32.297645 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 129/261] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:32 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:32.713049 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a54e196e-4a5b-4695-9448-271279f86cd1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Action: 'create', calling method: .version_select at 0x7f2da6c763a0>, body: {"keypair": {"name": "tempest-keypair-2089628749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSShnKT77J9jJGWnRTcfO96d8KUJopXhhcL4TF/quvzyWUWMqWVEex3llCCOF/PBRAHHCBvOouKE4lB9PXUObt1m4yWaB+0tNli9s76+ikPLedUcIGv8Md66A7LCxs8tw=="}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:32.730778 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-a54e196e-4a5b-4695-9448-271279f86cd1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Getting quotas for project f6160118ba95403e8df08ac74982954d. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:25:32.734821 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-a54e196e-4a5b-4695-9448-271279f86cd1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Getting quotas for user 146a7d1f40854f859864d463f403178f and project f6160118ba95403e8df08ac74982954d. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:25:32.890317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a54e196e-4a5b-4695-9448-271279f86cd1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180828 May 26 20:25:32.890915 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 133/262] 10.222.0.44 () {60 vars in 1158 bytes} [Thu May 26 20:25:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:33.207445 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2e9d1941-53a3-4ac4-8509-b4b981916c25 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:33.209619 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2e9d1941-53a3-4ac4-8509-b4b981916c25 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:33.214696 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e9d1941-53a3-4ac4-8509-b4b981916c25 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:33.215137 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e9d1941-53a3-4ac4-8509-b4b981916c25 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:33.218425 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e9d1941-53a3-4ac4-8509-b4b981916c25 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:33.219004 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e9d1941-53a3-4ac4-8509-b4b981916c25 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:33.315178 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b0607dfe-dfbe-45ff-80b0-ba1d92198ffa tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:33.316359 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b0607dfe-dfbe-45ff-80b0-ba1d92198ffa tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:33.324169 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b0607dfe-dfbe-45ff-80b0-ba1d92198ffa tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:33.324985 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b0607dfe-dfbe-45ff-80b0-ba1d92198ffa tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:33.325954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b0607dfe-dfbe-45ff-80b0-ba1d92198ffa tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:33.326307 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b0607dfe-dfbe-45ff-80b0-ba1d92198ffa tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:33.354768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2e9d1941-53a3-4ac4-8509-b4b981916c25 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:33.363839 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2e9d1941-53a3-4ac4-8509-b4b981916c25 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.160735 May 26 20:25:33.364621 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 130/263] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:33 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:33.400744 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b0607dfe-dfbe-45ff-80b0-ba1d92198ffa tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:33.410613 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b0607dfe-dfbe-45ff-80b0-ba1d92198ffa tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1279 microversion: 2.1 time: 0.100219 May 26 20:25:33.411363 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 134/264] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:33 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1279 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:34.381040 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-65d1797d-dd1c-490c-bc4f-76d3646776b0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:34.381926 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-65d1797d-dd1c-490c-bc4f-76d3646776b0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:34.388969 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-65d1797d-dd1c-490c-bc4f-76d3646776b0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:34.390328 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-65d1797d-dd1c-490c-bc4f-76d3646776b0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:34.391007 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-65d1797d-dd1c-490c-bc4f-76d3646776b0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:34.391454 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-65d1797d-dd1c-490c-bc4f-76d3646776b0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:34.427820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-24a39466-ce40-4627-bd35-ff9e755dde81 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:34.428601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-24a39466-ce40-4627-bd35-ff9e755dde81 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:34.435209 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24a39466-ce40-4627-bd35-ff9e755dde81 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:34.435712 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24a39466-ce40-4627-bd35-ff9e755dde81 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:34.437286 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24a39466-ce40-4627-bd35-ff9e755dde81 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:34.437724 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24a39466-ce40-4627-bd35-ff9e755dde81 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:34.511932 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-24a39466-ce40-4627-bd35-ff9e755dde81 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:34.520091 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-24a39466-ce40-4627-bd35-ff9e755dde81 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1279 microversion: 2.1 time: 0.096156 May 26 20:25:34.520666 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 135/265] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:34 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:34.554667 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-65d1797d-dd1c-490c-bc4f-76d3646776b0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:34.563333 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-65d1797d-dd1c-490c-bc4f-76d3646776b0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.186296 May 26 20:25:34.563889 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 131/266] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:34 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:35.340866 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-384165127", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9361726-4003-4ced-913d-aaf303561595"}], "security_groups": [{"name": "tempest-securitygroup--1752035881"}], "key_name": "tempest-keypair-2089628749", "user_data": "}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:35.446445 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.network.neutron [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] validate_networks() for [('a9361726-4003-4ced-913d-aaf303561595', None, None, None, None, None)] {{(pid=118306) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:25:35.539107 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6e0beeac-c67f-4e0e-b75a-d50301b16411 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:35.540500 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6e0beeac-c67f-4e0e-b75a-d50301b16411 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:35.547834 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e0beeac-c67f-4e0e-b75a-d50301b16411 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:35.548598 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e0beeac-c67f-4e0e-b75a-d50301b16411 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:35.549599 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e0beeac-c67f-4e0e-b75a-d50301b16411 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:35.550279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e0beeac-c67f-4e0e-b75a-d50301b16411 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:35.640494 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6e0beeac-c67f-4e0e-b75a-d50301b16411 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:35.651204 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6e0beeac-c67f-4e0e-b75a-d50301b16411 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1277 microversion: 2.1 time: 0.117872 May 26 20:25:35.652107 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 132/267] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:35 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:35.658123 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2cf545b4-d2c6-41c7-aef6-ea3f571334ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:35.658987 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2cf545b4-d2c6-41c7-aef6-ea3f571334ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:35.666849 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2cf545b4-d2c6-41c7-aef6-ea3f571334ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:35.667301 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2cf545b4-d2c6-41c7-aef6-ea3f571334ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:35.668578 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2cf545b4-d2c6-41c7-aef6-ea3f571334ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:35.669044 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2cf545b4-d2c6-41c7-aef6-ea3f571334ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:35.895925 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Flavor limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:25:35.896614 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Image limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:25:35.897095 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Flavor pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:25:35.897506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Image pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:25:35.897917 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:25:35.909526 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:35.910212 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:35.911067 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:35.911506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:35.942324 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Getting quotas for project f6160118ba95403e8df08ac74982954d. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:25:35.946734 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Getting quotas for user 146a7d1f40854f859864d463f403178f and project f6160118ba95403e8df08ac74982954d. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:25:35.959378 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Going to run 1 instances... {{(pid=118306) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:25:35.961639 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:25:35.995034 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2cf545b4-d2c6-41c7-aef6-ea3f571334ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:36.015888 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2cf545b4-d2c6-41c7-aef6-ea3f571334ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.361886 May 26 20:25:36.016769 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 133/268] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:35 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:36.107241 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-3d08dd00-e795-42d5-a788-108cd2040804 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.770592 May 26 20:25:36.108381 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 136/269] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:25:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:25:36.119210 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6394808f-5f0e-41ce-8afe-d0a2049e9564 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:36.120251 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6394808f-5f0e-41ce-8afe-d0a2049e9564 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:36.236523 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6394808f-5f0e-41ce-8afe-d0a2049e9564 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:36.270741 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6394808f-5f0e-41ce-8afe-d0a2049e9564 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1245 microversion: 2.1 time: 0.145105 May 26 20:25:36.270741 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 134/270] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:36 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1245 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:36.669958 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-d5a69d0c-2001-4f87-83d7-e8116ed30337 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:36.670639 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-d5a69d0c-2001-4f87-83d7-e8116ed30337 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:36.676903 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d5a69d0c-2001-4f87-83d7-e8116ed30337 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:36.679098 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d5a69d0c-2001-4f87-83d7-e8116ed30337 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:36.679098 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d5a69d0c-2001-4f87-83d7-e8116ed30337 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:36.679098 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d5a69d0c-2001-4f87-83d7-e8116ed30337 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:36.891915 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-d5a69d0c-2001-4f87-83d7-e8116ed30337 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:36.904241 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-d5a69d0c-2001-4f87-83d7-e8116ed30337 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1319 microversion: 2.1 time: 0.238733 May 26 20:25:36.913611 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 137/271] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:36 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:37.039173 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b944282e-ef44-4913-8d94-013826b8b612 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:37.040294 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b944282e-ef44-4913-8d94-013826b8b612 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:37.047390 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b944282e-ef44-4913-8d94-013826b8b612 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:37.048079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b944282e-ef44-4913-8d94-013826b8b612 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:37.049048 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b944282e-ef44-4913-8d94-013826b8b612 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:37.049711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b944282e-ef44-4913-8d94-013826b8b612 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:37.268888 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b944282e-ef44-4913-8d94-013826b8b612 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:37.277743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b944282e-ef44-4913-8d94-013826b8b612 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.242416 May 26 20:25:37.288973 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-083480bc-bddc-4678-9785-edc417448655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:37.290051 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 135/272] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:37 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:37.290649 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-083480bc-bddc-4678-9785-edc417448655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:37.299870 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-083480bc-bddc-4678-9785-edc417448655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:37.299870 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-083480bc-bddc-4678-9785-edc417448655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:37.299870 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-083480bc-bddc-4678-9785-edc417448655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:37.299870 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-083480bc-bddc-4678-9785-edc417448655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:37.377403 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-083480bc-bddc-4678-9785-edc417448655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:37.384924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-083480bc-bddc-4678-9785-edc417448655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1249 microversion: 2.1 time: 0.103553 May 26 20:25:37.385498 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 138/273] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:37 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1249 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:37.713792 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-775df370-2439-4088-a918-514f5d7260a9 req-27a06f07-f78f-42d7-8d41-0df2ff509f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c69e205-955e-4c96-a71f-65312359e1ef", "tag": "0e7c45b2-ac4a-4edd-ad28-0ba8e6a560c5"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:37.718033 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:37.724149 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-775df370-2439-4088-a918-514f5d7260a9 req-27a06f07-f78f-42d7-8d41-0df2ff509f57 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:37.724594 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-775df370-2439-4088-a918-514f5d7260a9 req-27a06f07-f78f-42d7-8d41-0df2ff509f57 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:37.736372 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-775df370-2439-4088-a918-514f5d7260a9 req-27a06f07-f78f-42d7-8d41-0df2ff509f57 service nova] Creating event network-changed:0e7c45b2-ac4a-4edd-ad28-0ba8e6a560c5 for instance 0c69e205-955e-4c96-a71f-65312359e1ef on hv-cinder-84213 May 26 20:25:37.741231 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-775df370-2439-4088-a918-514f5d7260a9 req-27a06f07-f78f-42d7-8d41-0df2ff509f57 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031375 May 26 20:25:37.741822 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 136/274] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:37.934821 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-98bc4c02-143c-4e02-8329-5ed42acae8fd tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:37.934821 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-98bc4c02-143c-4e02-8329-5ed42acae8fd tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:37.934821 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-98bc4c02-143c-4e02-8329-5ed42acae8fd tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:37.934821 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-98bc4c02-143c-4e02-8329-5ed42acae8fd tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:37.935658 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-98bc4c02-143c-4e02-8329-5ed42acae8fd tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:37.935658 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-98bc4c02-143c-4e02-8329-5ed42acae8fd tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:38.087432 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-98bc4c02-143c-4e02-8329-5ed42acae8fd tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:38.105354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-98bc4c02-143c-4e02-8329-5ed42acae8fd tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1319 microversion: 2.1 time: 0.188205 May 26 20:25:38.105965 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 139/275] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:37 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:38.298236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-84ce8e98-0d61-47ef-b5a3-b83c0ce201cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:38.299006 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-84ce8e98-0d61-47ef-b5a3-b83c0ce201cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:38.305923 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-84ce8e98-0d61-47ef-b5a3-b83c0ce201cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:38.306608 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-84ce8e98-0d61-47ef-b5a3-b83c0ce201cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:38.307447 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-84ce8e98-0d61-47ef-b5a3-b83c0ce201cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:38.307875 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-84ce8e98-0d61-47ef-b5a3-b83c0ce201cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:38.402531 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-83a33533-b7e0-4945-9c2d-0d99db43a06f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:38.403146 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-83a33533-b7e0-4945-9c2d-0d99db43a06f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:38.410296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-83a33533-b7e0-4945-9c2d-0d99db43a06f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:38.410791 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-83a33533-b7e0-4945-9c2d-0d99db43a06f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:38.411601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-83a33533-b7e0-4945-9c2d-0d99db43a06f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:38.412039 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-83a33533-b7e0-4945-9c2d-0d99db43a06f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:38.439807 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-84ce8e98-0d61-47ef-b5a3-b83c0ce201cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:38.448527 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-84ce8e98-0d61-47ef-b5a3-b83c0ce201cd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.155141 May 26 20:25:38.449107 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 137/276] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:38 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:38.475271 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-83a33533-b7e0-4945-9c2d-0d99db43a06f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:38.482970 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-83a33533-b7e0-4945-9c2d-0d99db43a06f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1249 microversion: 2.1 time: 0.084168 May 26 20:25:38.483536 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 140/277] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:38 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:39.123518 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ad1de817-5cea-4739-81d0-5775afd71993 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:39.124136 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ad1de817-5cea-4739-81d0-5775afd71993 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:39.131040 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ad1de817-5cea-4739-81d0-5775afd71993 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:39.131821 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ad1de817-5cea-4739-81d0-5775afd71993 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:39.132257 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ad1de817-5cea-4739-81d0-5775afd71993 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:39.132698 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ad1de817-5cea-4739-81d0-5775afd71993 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:39.264673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ad1de817-5cea-4739-81d0-5775afd71993 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:39.273155 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ad1de817-5cea-4739-81d0-5775afd71993 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1319 microversion: 2.1 time: 0.153805 May 26 20:25:39.273727 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 138/278] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:39 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:39.466051 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-757c38c5-37d8-4e3b-8cc7-135151aa68c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:39.466696 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-757c38c5-37d8-4e3b-8cc7-135151aa68c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:39.473851 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-757c38c5-37d8-4e3b-8cc7-135151aa68c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:39.474324 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-757c38c5-37d8-4e3b-8cc7-135151aa68c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:39.475076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-757c38c5-37d8-4e3b-8cc7-135151aa68c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:39.475503 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-757c38c5-37d8-4e3b-8cc7-135151aa68c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:39.500058 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cebef443-0606-4263-870b-303a62021378 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:39.500969 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cebef443-0606-4263-870b-303a62021378 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:39.507003 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cebef443-0606-4263-870b-303a62021378 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:39.507567 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cebef443-0606-4263-870b-303a62021378 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:39.508333 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cebef443-0606-4263-870b-303a62021378 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:39.508768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cebef443-0606-4263-870b-303a62021378 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:39.570615 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cebef443-0606-4263-870b-303a62021378 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:39.578750 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cebef443-0606-4263-870b-303a62021378 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1249 microversion: 2.1 time: 0.082547 May 26 20:25:39.579398 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 139/279] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:39 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:39.612434 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-757c38c5-37d8-4e3b-8cc7-135151aa68c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:39.623325 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-757c38c5-37d8-4e3b-8cc7-135151aa68c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.161151 May 26 20:25:39.623912 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 141/280] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:39 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:40.290597 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a69ec7a7-712d-4688-8d92-f98b96464c12 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:40.291880 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a69ec7a7-712d-4688-8d92-f98b96464c12 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:40.294307 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:40.300236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a69ec7a7-712d-4688-8d92-f98b96464c12 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:40.300670 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a69ec7a7-712d-4688-8d92-f98b96464c12 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:40.301453 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a69ec7a7-712d-4688-8d92-f98b96464c12 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:40.301878 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a69ec7a7-712d-4688-8d92-f98b96464c12 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:40.461911 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a69ec7a7-712d-4688-8d92-f98b96464c12 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:40.469800 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a69ec7a7-712d-4688-8d92-f98b96464c12 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1319 microversion: 2.1 time: 0.183383 May 26 20:25:40.470386 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 140/281] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:40 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:40.595936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-13c3d0de-483f-4abb-8802-7c03ecdd5d44 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:40.596499 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-13c3d0de-483f-4abb-8802-7c03ecdd5d44 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:40.602949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-13c3d0de-483f-4abb-8802-7c03ecdd5d44 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:40.603434 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-13c3d0de-483f-4abb-8802-7c03ecdd5d44 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:40.604271 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-13c3d0de-483f-4abb-8802-7c03ecdd5d44 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:40.604702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-13c3d0de-483f-4abb-8802-7c03ecdd5d44 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:40.641280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-aa9a3840-2dcd-4989-b0aa-e431a88258ef tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:40.642683 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-aa9a3840-2dcd-4989-b0aa-e431a88258ef tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:40.650789 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aa9a3840-2dcd-4989-b0aa-e431a88258ef tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:40.651517 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aa9a3840-2dcd-4989-b0aa-e431a88258ef tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:40.652522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aa9a3840-2dcd-4989-b0aa-e431a88258ef tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:40.653120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aa9a3840-2dcd-4989-b0aa-e431a88258ef tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:40.703593 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-13c3d0de-483f-4abb-8802-7c03ecdd5d44 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:40.711511 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-13c3d0de-483f-4abb-8802-7c03ecdd5d44 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1297 microversion: 2.1 time: 0.119933 May 26 20:25:40.712570 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 142/282] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:40 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:40.884783 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-aa9a3840-2dcd-4989-b0aa-e431a88258ef tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:40.896839 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-aa9a3840-2dcd-4989-b0aa-e431a88258ef tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.260327 May 26 20:25:40.907849 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 141/283] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:40 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:41.486578 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-eb8b97a2-c18c-4d1b-8ea8-a11c162dce8c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:41.487210 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-eb8b97a2-c18c-4d1b-8ea8-a11c162dce8c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:41.493508 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-eb8b97a2-c18c-4d1b-8ea8-a11c162dce8c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:41.494044 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-eb8b97a2-c18c-4d1b-8ea8-a11c162dce8c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:41.495013 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-eb8b97a2-c18c-4d1b-8ea8-a11c162dce8c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:41.495440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-eb8b97a2-c18c-4d1b-8ea8-a11c162dce8c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:41.641114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-eb8b97a2-c18c-4d1b-8ea8-a11c162dce8c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:41.650041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-eb8b97a2-c18c-4d1b-8ea8-a11c162dce8c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1319 microversion: 2.1 time: 0.167858 May 26 20:25:41.650768 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 143/284] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:41 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:41.729047 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f00b4743-1218-4ed8-8822-21430079afbc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:41.729687 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f00b4743-1218-4ed8-8822-21430079afbc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:41.736604 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f00b4743-1218-4ed8-8822-21430079afbc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:41.737053 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f00b4743-1218-4ed8-8822-21430079afbc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:41.737810 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f00b4743-1218-4ed8-8822-21430079afbc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:41.738257 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f00b4743-1218-4ed8-8822-21430079afbc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:41.804690 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f00b4743-1218-4ed8-8822-21430079afbc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:41.812284 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f00b4743-1218-4ed8-8822-21430079afbc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1315 microversion: 2.1 time: 0.087137 May 26 20:25:41.812838 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 142/285] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:41 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1315 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:41.919801 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a81a3e1c-f09a-4c45-a412-8c2006a5767e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:41.919801 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a81a3e1c-f09a-4c45-a412-8c2006a5767e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:41.926301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a81a3e1c-f09a-4c45-a412-8c2006a5767e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:41.926724 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a81a3e1c-f09a-4c45-a412-8c2006a5767e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:41.927846 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a81a3e1c-f09a-4c45-a412-8c2006a5767e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:41.928283 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a81a3e1c-f09a-4c45-a412-8c2006a5767e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:42.082549 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a81a3e1c-f09a-4c45-a412-8c2006a5767e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:42.090652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a81a3e1c-f09a-4c45-a412-8c2006a5767e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.179060 May 26 20:25:42.091222 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 144/286] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:41 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:42.667421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1c70165c-3767-42c4-afd0-5f95b0d956b8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:42.668037 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1c70165c-3767-42c4-afd0-5f95b0d956b8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:42.675455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1c70165c-3767-42c4-afd0-5f95b0d956b8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:42.675911 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1c70165c-3767-42c4-afd0-5f95b0d956b8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:42.735065 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1c70165c-3767-42c4-afd0-5f95b0d956b8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:42.735065 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1c70165c-3767-42c4-afd0-5f95b0d956b8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:42.806668 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-1c70165c-3767-42c4-afd0-5f95b0d956b8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:42.814767 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1c70165c-3767-42c4-afd0-5f95b0d956b8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1319 microversion: 2.1 time: 0.151326 May 26 20:25:42.815413 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 143/287] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:42 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:42.829594 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6bc36d3c-db76-45af-930f-0bbb893a8d3a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:42.830211 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6bc36d3c-db76-45af-930f-0bbb893a8d3a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:42.836886 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6bc36d3c-db76-45af-930f-0bbb893a8d3a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:42.837335 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6bc36d3c-db76-45af-930f-0bbb893a8d3a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:42.838092 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6bc36d3c-db76-45af-930f-0bbb893a8d3a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:42.838674 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6bc36d3c-db76-45af-930f-0bbb893a8d3a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:42.980864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6bc36d3c-db76-45af-930f-0bbb893a8d3a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:42.989185 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6bc36d3c-db76-45af-930f-0bbb893a8d3a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1383 microversion: 2.1 time: 0.164185 May 26 20:25:42.989699 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 145/288] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:42 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1383 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:43.108765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8a1e2e73-ed25-47ff-b381-82de53acb97d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:43.109413 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8a1e2e73-ed25-47ff-b381-82de53acb97d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:43.115326 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8a1e2e73-ed25-47ff-b381-82de53acb97d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:43.115771 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8a1e2e73-ed25-47ff-b381-82de53acb97d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:43.116522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8a1e2e73-ed25-47ff-b381-82de53acb97d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:43.116951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8a1e2e73-ed25-47ff-b381-82de53acb97d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:43.249032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-8a1e2e73-ed25-47ff-b381-82de53acb97d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:43.257733 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8a1e2e73-ed25-47ff-b381-82de53acb97d tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.152987 May 26 20:25:43.258323 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 144/289] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:43 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:43.833627 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ff282c29-fbab-46a0-8261-0f13b660aa78 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:43.834378 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ff282c29-fbab-46a0-8261-0f13b660aa78 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:43.840986 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ff282c29-fbab-46a0-8261-0f13b660aa78 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:43.841436 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ff282c29-fbab-46a0-8261-0f13b660aa78 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:43.842491 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ff282c29-fbab-46a0-8261-0f13b660aa78 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:43.842939 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ff282c29-fbab-46a0-8261-0f13b660aa78 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:43.861742 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=100 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:43.977243 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ff282c29-fbab-46a0-8261-0f13b660aa78 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:43.986557 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ff282c29-fbab-46a0-8261-0f13b660aa78 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1319 microversion: 2.1 time: 0.156750 May 26 20:25:43.987136 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 146/290] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:43 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:44.007124 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7e679a82-2351-463e-9494-9b1fde9e287f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:44.007780 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7e679a82-2351-463e-9494-9b1fde9e287f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:44.014122 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e679a82-2351-463e-9494-9b1fde9e287f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:44.014763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e679a82-2351-463e-9494-9b1fde9e287f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:44.016270 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e679a82-2351-463e-9494-9b1fde9e287f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:44.016918 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7e679a82-2351-463e-9494-9b1fde9e287f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:44.020998 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:44.143817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7e679a82-2351-463e-9494-9b1fde9e287f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:44.151041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7e679a82-2351-463e-9494-9b1fde9e287f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1383 microversion: 2.1 time: 0.148984 May 26 20:25:44.151603 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 145/291] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:44 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1383 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:44.275166 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-f898710d-995e-4998-a00b-99798ac8257f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:44.275775 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-f898710d-995e-4998-a00b-99798ac8257f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:44.282360 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f898710d-995e-4998-a00b-99798ac8257f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:44.282815 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f898710d-995e-4998-a00b-99798ac8257f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:44.283568 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f898710d-995e-4998-a00b-99798ac8257f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:44.284001 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f898710d-995e-4998-a00b-99798ac8257f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:44.413412 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-f898710d-995e-4998-a00b-99798ac8257f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:44.421242 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-f898710d-995e-4998-a00b-99798ac8257f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.149984 May 26 20:25:44.422492 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 147/292] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:44 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:45.002950 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-00ba0f0a-8d69-4995-83db-a08fd478f7b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:45.003635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-00ba0f0a-8d69-4995-83db-a08fd478f7b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:45.010268 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00ba0f0a-8d69-4995-83db-a08fd478f7b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:45.010943 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00ba0f0a-8d69-4995-83db-a08fd478f7b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:45.011855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00ba0f0a-8d69-4995-83db-a08fd478f7b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:45.012371 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-00ba0f0a-8d69-4995-83db-a08fd478f7b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:45.167737 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-fbefed01-5439-4dd9-92d7-9115a6c6673f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:45.168261 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-fbefed01-5439-4dd9-92d7-9115a6c6673f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:45.174814 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fbefed01-5439-4dd9-92d7-9115a6c6673f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:45.175265 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fbefed01-5439-4dd9-92d7-9115a6c6673f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:45.176036 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fbefed01-5439-4dd9-92d7-9115a6c6673f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:45.176473 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fbefed01-5439-4dd9-92d7-9115a6c6673f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:45.264710 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-00ba0f0a-8d69-4995-83db-a08fd478f7b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:45.273614 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-00ba0f0a-8d69-4995-83db-a08fd478f7b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1319 microversion: 2.1 time: 0.274935 May 26 20:25:45.274441 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 146/293] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:44 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:45.311231 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-fbefed01-5439-4dd9-92d7-9115a6c6673f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:45.319010 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-fbefed01-5439-4dd9-92d7-9115a6c6673f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1371 microversion: 2.1 time: 0.155245 May 26 20:25:45.319587 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 148/294] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:45 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:45.439793 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8f3a18df-5824-4ea8-a837-edd16281f531 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:45.440325 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8f3a18df-5824-4ea8-a837-edd16281f531 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:45.446292 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8f3a18df-5824-4ea8-a837-edd16281f531 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:45.446737 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8f3a18df-5824-4ea8-a837-edd16281f531 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:45.447489 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8f3a18df-5824-4ea8-a837-edd16281f531 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:45.447919 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8f3a18df-5824-4ea8-a837-edd16281f531 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:45.686692 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-8f3a18df-5824-4ea8-a837-edd16281f531 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:45.701803 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8f3a18df-5824-4ea8-a837-edd16281f531 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.266185 May 26 20:25:45.703435 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 147/295] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:45 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:45.867249 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-7cb608b3-67be-4675-87b4-3649e525d343 req-88594e42-3ee9-4394-aee8-dbebdf44cba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6602854b-bca1-47cb-9307-9e01ce9e96d7", "tag": "fc329004-fdd7-4ee6-a7be-33d3addac5bc"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:45.883408 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-7cb608b3-67be-4675-87b4-3649e525d343 req-88594e42-3ee9-4394-aee8-dbebdf44cba2 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:45.884045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-7cb608b3-67be-4675-87b4-3649e525d343 req-88594e42-3ee9-4394-aee8-dbebdf44cba2 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:45.928962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-7cb608b3-67be-4675-87b4-3649e525d343 req-88594e42-3ee9-4394-aee8-dbebdf44cba2 service nova] Creating event network-changed:fc329004-fdd7-4ee6-a7be-33d3addac5bc for instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 on hv-cinder-84213 May 26 20:25:45.932524 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:45.934388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-7cb608b3-67be-4675-87b4-3649e525d343 req-88594e42-3ee9-4394-aee8-dbebdf44cba2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071494 May 26 20:25:45.935308 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 149/296] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:46.293433 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-006865c7-64f1-45c2-bf28-3fca27263af7 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:46.294056 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-006865c7-64f1-45c2-bf28-3fca27263af7 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:46.296092 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=8 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:46.305310 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-006865c7-64f1-45c2-bf28-3fca27263af7 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:46.305868 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-006865c7-64f1-45c2-bf28-3fca27263af7 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:46.309135 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-006865c7-64f1-45c2-bf28-3fca27263af7 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:46.309783 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-006865c7-64f1-45c2-bf28-3fca27263af7 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:46.334019 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=14 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:46.339931 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-908e1e7a-2cf5-4db8-8013-a440aa5cf68e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:46.341258 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-908e1e7a-2cf5-4db8-8013-a440aa5cf68e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:46.348956 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-908e1e7a-2cf5-4db8-8013-a440aa5cf68e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:46.349731 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-908e1e7a-2cf5-4db8-8013-a440aa5cf68e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:46.350537 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-908e1e7a-2cf5-4db8-8013-a440aa5cf68e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:46.351139 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-908e1e7a-2cf5-4db8-8013-a440aa5cf68e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:46.505906 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-908e1e7a-2cf5-4db8-8013-a440aa5cf68e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:46.514110 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-908e1e7a-2cf5-4db8-8013-a440aa5cf68e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1371 microversion: 2.1 time: 0.180788 May 26 20:25:46.514916 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 150/297] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:46 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:46.561211 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-006865c7-64f1-45c2-bf28-3fca27263af7 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:46.566885 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-006865c7-64f1-45c2-bf28-3fca27263af7 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1319 microversion: 2.1 time: 0.279381 May 26 20:25:46.567330 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 148/298] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:46 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:46.722324 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-3e38a7b6-9dfe-4410-b0f5-59962a3d33ea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:46.722859 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3e38a7b6-9dfe-4410-b0f5-59962a3d33ea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:46.729119 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3e38a7b6-9dfe-4410-b0f5-59962a3d33ea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:46.729566 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3e38a7b6-9dfe-4410-b0f5-59962a3d33ea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:46.730353 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3e38a7b6-9dfe-4410-b0f5-59962a3d33ea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:46.730784 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3e38a7b6-9dfe-4410-b0f5-59962a3d33ea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:46.872178 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-3e38a7b6-9dfe-4410-b0f5-59962a3d33ea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:46.880254 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-3e38a7b6-9dfe-4410-b0f5-59962a3d33ea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.163143 May 26 20:25:46.880823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 151/299] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:46 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:47.414822 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-4841f570-d499-487b-923c-994ce585f110 req-25a61c79-af42-4616-8b41-ec9f07dd8a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c69e205-955e-4c96-a71f-65312359e1ef", "name": "network-vif-plugged", "status": "completed", "tag": "0e7c45b2-ac4a-4edd-ad28-0ba8e6a560c5"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:47.428018 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4841f570-d499-487b-923c-994ce585f110 req-25a61c79-af42-4616-8b41-ec9f07dd8a5d service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:47.428396 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4841f570-d499-487b-923c-994ce585f110 req-25a61c79-af42-4616-8b41-ec9f07dd8a5d service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:47.440687 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-4841f570-d499-487b-923c-994ce585f110 req-25a61c79-af42-4616-8b41-ec9f07dd8a5d service nova] Creating event network-vif-plugged:0e7c45b2-ac4a-4edd-ad28-0ba8e6a560c5 for instance 0c69e205-955e-4c96-a71f-65312359e1ef on hv-cinder-84213 May 26 20:25:47.445476 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-4841f570-d499-487b-923c-994ce585f110 req-25a61c79-af42-4616-8b41-ec9f07dd8a5d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034270 May 26 20:25:47.446296 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 149/300] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:47.537174 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-969100ca-5968-4121-a71e-2339797ad7a1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:47.537786 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-969100ca-5968-4121-a71e-2339797ad7a1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:47.544616 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-969100ca-5968-4121-a71e-2339797ad7a1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:47.545292 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-969100ca-5968-4121-a71e-2339797ad7a1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:47.546074 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-969100ca-5968-4121-a71e-2339797ad7a1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:47.546551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-969100ca-5968-4121-a71e-2339797ad7a1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:47.585376 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e9983aa9-b81a-43fd-b78e-4a9ab7ccd1bf tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:47.588131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e9983aa9-b81a-43fd-b78e-4a9ab7ccd1bf tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:47.595377 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9983aa9-b81a-43fd-b78e-4a9ab7ccd1bf tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:47.596051 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9983aa9-b81a-43fd-b78e-4a9ab7ccd1bf tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:47.596946 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9983aa9-b81a-43fd-b78e-4a9ab7ccd1bf tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:47.597388 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9983aa9-b81a-43fd-b78e-4a9ab7ccd1bf tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:47.708671 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-969100ca-5968-4121-a71e-2339797ad7a1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:47.734362 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-969100ca-5968-4121-a71e-2339797ad7a1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1371 microversion: 2.1 time: 0.199534 May 26 20:25:47.736002 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 152/301] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:47 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:47.846855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e9983aa9-b81a-43fd-b78e-4a9ab7ccd1bf tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:47.846855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e9983aa9-b81a-43fd-b78e-4a9ab7ccd1bf tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1319 microversion: 2.1 time: 0.212280 May 26 20:25:47.846855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 150/302] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:47 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:47.897035 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9af6a967-aedd-4fd9-a234-fae3a85773b5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:47.897671 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9af6a967-aedd-4fd9-a234-fae3a85773b5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:47.903686 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9af6a967-aedd-4fd9-a234-fae3a85773b5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:47.904138 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9af6a967-aedd-4fd9-a234-fae3a85773b5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:47.904895 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9af6a967-aedd-4fd9-a234-fae3a85773b5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:47.905333 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9af6a967-aedd-4fd9-a234-fae3a85773b5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:48.045036 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9af6a967-aedd-4fd9-a234-fae3a85773b5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:48.056033 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9af6a967-aedd-4fd9-a234-fae3a85773b5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.162831 May 26 20:25:48.057586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 153/303] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:47 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:48.753166 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8ee37536-c9a7-46da-bede-46767e62082b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:48.753768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8ee37536-c9a7-46da-bede-46767e62082b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:48.759722 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8ee37536-c9a7-46da-bede-46767e62082b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:48.760161 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8ee37536-c9a7-46da-bede-46767e62082b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:48.760910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8ee37536-c9a7-46da-bede-46767e62082b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:48.761337 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8ee37536-c9a7-46da-bede-46767e62082b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:48.811153 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a74959cd-6c23-4054-9371-c087c2ef5b5e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:48.811776 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a74959cd-6c23-4054-9371-c087c2ef5b5e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:48.818927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a74959cd-6c23-4054-9371-c087c2ef5b5e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:48.819391 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a74959cd-6c23-4054-9371-c087c2ef5b5e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:48.820170 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a74959cd-6c23-4054-9371-c087c2ef5b5e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:48.820600 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a74959cd-6c23-4054-9371-c087c2ef5b5e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:48.909987 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-8ee37536-c9a7-46da-bede-46767e62082b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:48.924136 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8ee37536-c9a7-46da-bede-46767e62082b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1371 microversion: 2.1 time: 0.175370 May 26 20:25:48.926408 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 151/304] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:48 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:48.994782 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a74959cd-6c23-4054-9371-c087c2ef5b5e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:49.003103 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a74959cd-6c23-4054-9371-c087c2ef5b5e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1319 microversion: 2.1 time: 0.195619 May 26 20:25:49.004249 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 154/305] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:48 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:49.073666 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-76b5cb94-0e2f-43ff-b011-8249e32ff737 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:49.074337 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-76b5cb94-0e2f-43ff-b011-8249e32ff737 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:49.081022 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-76b5cb94-0e2f-43ff-b011-8249e32ff737 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:49.081469 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-76b5cb94-0e2f-43ff-b011-8249e32ff737 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:49.082228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-76b5cb94-0e2f-43ff-b011-8249e32ff737 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:49.082688 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-76b5cb94-0e2f-43ff-b011-8249e32ff737 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:49.243544 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-76b5cb94-0e2f-43ff-b011-8249e32ff737 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:49.253699 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-76b5cb94-0e2f-43ff-b011-8249e32ff737 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.183851 May 26 20:25:49.255104 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 152/306] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:49 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:49.942970 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e14047c8-1e24-46ff-a193-e1d4f1c1c56b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:49.943596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e14047c8-1e24-46ff-a193-e1d4f1c1c56b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:49.950637 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e14047c8-1e24-46ff-a193-e1d4f1c1c56b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:49.951025 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e14047c8-1e24-46ff-a193-e1d4f1c1c56b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:49.951888 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e14047c8-1e24-46ff-a193-e1d4f1c1c56b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:49.952348 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e14047c8-1e24-46ff-a193-e1d4f1c1c56b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:50.019893 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1c4be2a1-6c7f-4b75-845d-f09b852b06be tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:50.020491 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1c4be2a1-6c7f-4b75-845d-f09b852b06be tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:50.026869 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1c4be2a1-6c7f-4b75-845d-f09b852b06be tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:50.029513 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1c4be2a1-6c7f-4b75-845d-f09b852b06be tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:50.029513 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1c4be2a1-6c7f-4b75-845d-f09b852b06be tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:50.029513 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1c4be2a1-6c7f-4b75-845d-f09b852b06be tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:50.121230 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e14047c8-1e24-46ff-a193-e1d4f1c1c56b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:50.133718 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e14047c8-1e24-46ff-a193-e1d4f1c1c56b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1371 microversion: 2.1 time: 0.194124 May 26 20:25:50.134997 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 155/307] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:49 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:50.275761 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1f3dad9a-e419-4cb1-a026-2ebc7a9ce59b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:50.279817 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-1f3dad9a-e419-4cb1-a026-2ebc7a9ce59b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:50.289053 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1f3dad9a-e419-4cb1-a026-2ebc7a9ce59b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:50.290048 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1f3dad9a-e419-4cb1-a026-2ebc7a9ce59b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:50.292750 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1f3dad9a-e419-4cb1-a026-2ebc7a9ce59b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:50.293692 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1f3dad9a-e419-4cb1-a026-2ebc7a9ce59b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:50.492361 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1f3dad9a-e419-4cb1-a026-2ebc7a9ce59b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:50.507887 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1f3dad9a-e419-4cb1-a026-2ebc7a9ce59b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1722 microversion: 2.1 time: 0.239617 May 26 20:25:50.508481 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 156/308] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:50 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:50.536642 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-1c4be2a1-6c7f-4b75-845d-f09b852b06be tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:50.545669 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1c4be2a1-6c7f-4b75-845d-f09b852b06be tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1319 microversion: 2.1 time: 0.530098 May 26 20:25:50.548525 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 153/309] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:50 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:51.152157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4f299ee6-1db6-4256-b8e0-ffcb44d9760e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:51.152884 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4f299ee6-1db6-4256-b8e0-ffcb44d9760e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:51.160388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4f299ee6-1db6-4256-b8e0-ffcb44d9760e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:51.160928 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4f299ee6-1db6-4256-b8e0-ffcb44d9760e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:51.161782 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4f299ee6-1db6-4256-b8e0-ffcb44d9760e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:51.162321 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4f299ee6-1db6-4256-b8e0-ffcb44d9760e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:51.298965 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4f299ee6-1db6-4256-b8e0-ffcb44d9760e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:51.307067 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4f299ee6-1db6-4256-b8e0-ffcb44d9760e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1371 microversion: 2.1 time: 0.159501 May 26 20:25:51.307644 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 157/310] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:51 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:51.444449 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-cfd25f6d-ab10-4f50-ab1e-d1a236b2f2c5 req-d14117c1-d1f4-415c-96a4-032c7cfd1c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6602854b-bca1-47cb-9307-9e01ce9e96d7", "name": "network-vif-plugged", "status": "completed", "tag": "fc329004-fdd7-4ee6-a7be-33d3addac5bc"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:51.453158 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-cfd25f6d-ab10-4f50-ab1e-d1a236b2f2c5 req-d14117c1-d1f4-415c-96a4-032c7cfd1c9a service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:51.454424 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-cfd25f6d-ab10-4f50-ab1e-d1a236b2f2c5 req-d14117c1-d1f4-415c-96a4-032c7cfd1c9a service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:51.466149 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-cfd25f6d-ab10-4f50-ab1e-d1a236b2f2c5 req-d14117c1-d1f4-415c-96a4-032c7cfd1c9a service nova] Creating event network-vif-plugged:fc329004-fdd7-4ee6-a7be-33d3addac5bc for instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 on hv-cinder-84213 May 26 20:25:51.472245 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-cfd25f6d-ab10-4f50-ab1e-d1a236b2f2c5 req-d14117c1-d1f4-415c-96a4-032c7cfd1c9a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031508 May 26 20:25:51.473445 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 154/311] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:51.525023 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-361e41f3-31b5-4bd8-8ed7-7236e6355ee4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:51.525864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-361e41f3-31b5-4bd8-8ed7-7236e6355ee4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:51.533392 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-361e41f3-31b5-4bd8-8ed7-7236e6355ee4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:51.534156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-361e41f3-31b5-4bd8-8ed7-7236e6355ee4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:51.535222 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-361e41f3-31b5-4bd8-8ed7-7236e6355ee4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:51.535899 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-361e41f3-31b5-4bd8-8ed7-7236e6355ee4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:51.565626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5591dd5b-9c9b-4e83-9dff-d7d3e6e465a3 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:51.566397 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5591dd5b-9c9b-4e83-9dff-d7d3e6e465a3 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:51.573072 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5591dd5b-9c9b-4e83-9dff-d7d3e6e465a3 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:51.573907 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5591dd5b-9c9b-4e83-9dff-d7d3e6e465a3 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:51.575059 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5591dd5b-9c9b-4e83-9dff-d7d3e6e465a3 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:51.575653 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5591dd5b-9c9b-4e83-9dff-d7d3e6e465a3 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:51.728236 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-361e41f3-31b5-4bd8-8ed7-7236e6355ee4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:51.738699 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-361e41f3-31b5-4bd8-8ed7-7236e6355ee4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1699 microversion: 2.1 time: 0.217508 May 26 20:25:51.750397 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 158/312] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:51 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1699 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:51.769625 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a8cdaf66-8802-4084-b987-b3aea1f14dae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:51.777583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5591dd5b-9c9b-4e83-9dff-d7d3e6e465a3 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:51.778364 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a8cdaf66-8802-4084-b987-b3aea1f14dae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:51.779041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a8cdaf66-8802-4084-b987-b3aea1f14dae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:51.788113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5591dd5b-9c9b-4e83-9dff-d7d3e6e465a3 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1507 microversion: 2.1 time: 0.225818 May 26 20:25:51.788906 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 155/313] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:51 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:51.857448 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a8cdaf66-8802-4084-b987-b3aea1f14dae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Going to try to start instance {{(pid=118306) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 20:25:52.107663 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a8cdaf66-8802-4084-b987-b3aea1f14dae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "POST /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/action" status: 202 len: 0 microversion: 2.1 time: 0.343196 May 26 20:25:52.109820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 159/314] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:25:51 2022] POST /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:25:52.122868 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-497c3e14-bcdd-4ef1-b111-e0454d7c2d2f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:52.123638 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-497c3e14-bcdd-4ef1-b111-e0454d7c2d2f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:52.132243 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-497c3e14-bcdd-4ef1-b111-e0454d7c2d2f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:52.132700 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-497c3e14-bcdd-4ef1-b111-e0454d7c2d2f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:52.133485 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-497c3e14-bcdd-4ef1-b111-e0454d7c2d2f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:52.134091 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-497c3e14-bcdd-4ef1-b111-e0454d7c2d2f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:52.326666 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-66ab04a8-c637-4597-8f93-7c8b131a9a82 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:52.328133 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-66ab04a8-c637-4597-8f93-7c8b131a9a82 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:52.338939 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-66ab04a8-c637-4597-8f93-7c8b131a9a82 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:52.338939 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-66ab04a8-c637-4597-8f93-7c8b131a9a82 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:52.339792 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-66ab04a8-c637-4597-8f93-7c8b131a9a82 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:52.340678 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-66ab04a8-c637-4597-8f93-7c8b131a9a82 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:52.365961 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-497c3e14-bcdd-4ef1-b111-e0454d7c2d2f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:52.379213 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-497c3e14-bcdd-4ef1-b111-e0454d7c2d2f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1708 microversion: 2.1 time: 0.260868 May 26 20:25:52.381200 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 156/315] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:52 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1708 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:52.535817 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-66ab04a8-c637-4597-8f93-7c8b131a9a82 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:52.543572 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-66ab04a8-c637-4597-8f93-7c8b131a9a82 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1371 microversion: 2.1 time: 0.222396 May 26 20:25:52.544127 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 160/316] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:52 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:53.397554 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b0bd59a0-8c17-4a79-a2c3-f3d6f1834215 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:53.398168 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b0bd59a0-8c17-4a79-a2c3-f3d6f1834215 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:53.404926 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b0bd59a0-8c17-4a79-a2c3-f3d6f1834215 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:53.405635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b0bd59a0-8c17-4a79-a2c3-f3d6f1834215 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:53.406672 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b0bd59a0-8c17-4a79-a2c3-f3d6f1834215 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:53.408098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b0bd59a0-8c17-4a79-a2c3-f3d6f1834215 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:53.561016 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-afaac275-6669-49f8-8d71-8cda0305a4ed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:53.561758 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-afaac275-6669-49f8-8d71-8cda0305a4ed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:53.568786 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-afaac275-6669-49f8-8d71-8cda0305a4ed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:53.569242 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-afaac275-6669-49f8-8d71-8cda0305a4ed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:53.570037 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-afaac275-6669-49f8-8d71-8cda0305a4ed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:53.570561 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-afaac275-6669-49f8-8d71-8cda0305a4ed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:53.690928 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b0bd59a0-8c17-4a79-a2c3-f3d6f1834215 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:53.701082 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b0bd59a0-8c17-4a79-a2c3-f3d6f1834215 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1708 microversion: 2.1 time: 0.307011 May 26 20:25:53.702177 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 157/317] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:53 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1708 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:53.819252 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-afaac275-6669-49f8-8d71-8cda0305a4ed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:53.827166 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-afaac275-6669-49f8-8d71-8cda0305a4ed tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1371 microversion: 2.1 time: 0.270080 May 26 20:25:53.837413 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 161/318] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:53 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:54.719774 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-410317f2-9fc7-4818-aeb7-443ee87055a9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:54.720381 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-410317f2-9fc7-4818-aeb7-443ee87055a9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:54.726468 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-410317f2-9fc7-4818-aeb7-443ee87055a9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:54.726914 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-410317f2-9fc7-4818-aeb7-443ee87055a9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:54.727674 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-410317f2-9fc7-4818-aeb7-443ee87055a9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:54.728105 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-410317f2-9fc7-4818-aeb7-443ee87055a9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:54.848235 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5ea4c307-9c88-4523-8d15-00d8fb73fdd6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:54.848852 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5ea4c307-9c88-4523-8d15-00d8fb73fdd6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:54.860685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5ea4c307-9c88-4523-8d15-00d8fb73fdd6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:54.860685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5ea4c307-9c88-4523-8d15-00d8fb73fdd6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:54.860685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5ea4c307-9c88-4523-8d15-00d8fb73fdd6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:54.860685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5ea4c307-9c88-4523-8d15-00d8fb73fdd6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:54.884745 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-410317f2-9fc7-4818-aeb7-443ee87055a9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:54.893410 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-410317f2-9fc7-4818-aeb7-443ee87055a9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1708 microversion: 2.1 time: 0.177995 May 26 20:25:54.893990 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 158/319] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:54 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1708 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:25:55.011740 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5ea4c307-9c88-4523-8d15-00d8fb73fdd6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:55.015862 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:55.021914 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5ea4c307-9c88-4523-8d15-00d8fb73fdd6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1564 microversion: 2.1 time: 0.180603 May 26 20:25:55.022578 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 162/320] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:54 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1564 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:55.039457 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-db4e2f2d-9e52-4567-898b-7c205c676991 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:55.039948 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-db4e2f2d-9e52-4567-898b-7c205c676991 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:55.046229 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db4e2f2d-9e52-4567-898b-7c205c676991 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:55.046726 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db4e2f2d-9e52-4567-898b-7c205c676991 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:55.054205 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db4e2f2d-9e52-4567-898b-7c205c676991 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:55.054205 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db4e2f2d-9e52-4567-898b-7c205c676991 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:55.128922 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-db4e2f2d-9e52-4567-898b-7c205c676991 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093335 May 26 20:25:55.129562 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 159/321] 10.222.0.44 () {58 vars in 1274 bytes} [Thu May 26 20:25:55 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:25:55.915338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c876e747-fa31-456b-aef3-6124766e9d04 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:25:55.915940 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c876e747-fa31-456b-aef3-6124766e9d04 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:25:55.923844 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c876e747-fa31-456b-aef3-6124766e9d04 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:55.924285 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c876e747-fa31-456b-aef3-6124766e9d04 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:55.925035 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c876e747-fa31-456b-aef3-6124766e9d04 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:55.925471 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c876e747-fa31-456b-aef3-6124766e9d04 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:56.158803 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c876e747-fa31-456b-aef3-6124766e9d04 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:25:56.167064 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c876e747-fa31-456b-aef3-6124766e9d04 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1712 microversion: 2.1 time: 0.255646 May 26 20:25:56.167644 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 163/322] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:25:55 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1712 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:25:56.716133 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-e7c4b488-a162-409a-82c3-3adbd0421e91 req-d153e3c6-8bd8-411d-a313-8b72ef3ef682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6602854b-bca1-47cb-9307-9e01ce9e96d7", "tag": "fc329004-fdd7-4ee6-a7be-33d3addac5bc"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:25:56.725070 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e7c4b488-a162-409a-82c3-3adbd0421e91 req-d153e3c6-8bd8-411d-a313-8b72ef3ef682 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:25:56.729919 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e7c4b488-a162-409a-82c3-3adbd0421e91 req-d153e3c6-8bd8-411d-a313-8b72ef3ef682 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:25:56.737759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-e7c4b488-a162-409a-82c3-3adbd0421e91 req-d153e3c6-8bd8-411d-a313-8b72ef3ef682 service nova] Creating event network-changed:fc329004-fdd7-4ee6-a7be-33d3addac5bc for instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 on hv-cinder-84213 May 26 20:25:56.743093 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-e7c4b488-a162-409a-82c3-3adbd0421e91 req-d153e3c6-8bd8-411d-a313-8b72ef3ef682 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030726 May 26 20:25:56.744182 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 160/323] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:26:09.349814 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-94856eaf-a2b6-472f-bdc2-e713364795d9 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:09.350419 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-94856eaf-a2b6-472f-bdc2-e713364795d9 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:09.353026 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:09.353819 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=6 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:09.358628 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-94856eaf-a2b6-472f-bdc2-e713364795d9 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:09.359049 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-94856eaf-a2b6-472f-bdc2-e713364795d9 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:09.359965 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-94856eaf-a2b6-472f-bdc2-e713364795d9 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:09.360401 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-94856eaf-a2b6-472f-bdc2-e713364795d9 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:09.385309 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-94856eaf-a2b6-472f-bdc2-e713364795d9 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/ips" status: 200 len: 149 microversion: 2.1 time: 0.039964 May 26 20:26:09.386223 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 164/324] 10.222.0.44 () {58 vars in 1247 bytes} [Thu May 26 20:26:09 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:26:11.215340 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=49 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:11.216262 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=81 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:11.220630 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d790c4cf-32ea-4953-b460-3a8c97b2f413 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3243204d-dd73-4112-8756-d6af135952c9"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:26:11.221792 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d790c4cf-32ea-4953-b460-3a8c97b2f413 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:11.228222 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d790c4cf-32ea-4953-b460-3a8c97b2f413 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:11.228700 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d790c4cf-32ea-4953-b460-3a8c97b2f413 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:11.234365 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d790c4cf-32ea-4953-b460-3a8c97b2f413 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:11.234365 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d790c4cf-32ea-4953-b460-3a8c97b2f413 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:11.993550 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d790c4cf-32ea-4953-b460-3a8c97b2f413 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779096 May 26 20:26:11.994350 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 161/325] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:26:11 2022] POST /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:26:20.553056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8959b3ed-3ee7-4c2c-8479-7f8fb92b88ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: .version_select at 0x7f2da480af70>, body: {"keypair": {"name": "tempest-keypair-1877103220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTo4as2nEvcdaSV5S2VJiIT+EG5IOYpZabAXshHd+URhVdZ0uO5Y7QIK7/o1ZeT7eSo9NwqMc4IDRyKsvKA1mhufKLPMMso0kkPoAY2+ekfEYjtY7JAw8YfB2cJ0tYH2w=="}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:26:20.568649 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-8959b3ed-3ee7-4c2c-8479-7f8fb92b88ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:26:20.573802 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-8959b3ed-3ee7-4c2c-8479-7f8fb92b88ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for user f57c87dc60754d3aa87a84605c7a6889 and project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:26:20.657643 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8959b3ed-3ee7-4c2c-8479-7f8fb92b88ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109032 May 26 20:26:20.658233 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 165/326] 10.222.0.44 () {60 vars in 1158 bytes} [Thu May 26 20:26:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:26:22.220027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fc5c40a6-1de8-4ab3-ba9d-8e7b66082266 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "529d0a81-831b-4d58-a5fa-c64d4e4224af", "device": "/dev/sdb"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:26:22.221761 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fc5c40a6-1de8-4ab3-ba9d-8e7b66082266 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:22.224339 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:22.227554 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:22.231962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc5c40a6-1de8-4ab3-ba9d-8e7b66082266 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:22.232418 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc5c40a6-1de8-4ab3-ba9d-8e7b66082266 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:22.233208 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc5c40a6-1de8-4ab3-ba9d-8e7b66082266 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:22.233670 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc5c40a6-1de8-4ab3-ba9d-8e7b66082266 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:22.931420 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1370102502", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d8f9587-b15f-4a25-9b7c-c72960c971d6"}], "security_groups": [{"name": "tempest-securitygroup--323012640"}], "key_name": "tempest-keypair-1877103220", "user_data": "}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:26:23.026175 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fc5c40a6-1de8-4ab3-ba9d-8e7b66082266 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "POST /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811574 May 26 20:26:23.026857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 162/327] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:26:22 2022] POST /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef/os-volume_attachments => generated 194 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:26:23.035789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.network.neutron [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] validate_networks() for [('0d8f9587-b15f-4a25-9b7c-c72960c971d6', None, None, None, None, None)] {{(pid=118306) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:26:23.407598 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Flavor limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:26:23.408060 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Image limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:26:23.408645 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Flavor pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:26:23.409076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Image pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:26:23.409482 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:26:23.418922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:23.419467 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:23.420308 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:23.420749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:23.438547 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:26:23.442536 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for user f57c87dc60754d3aa87a84605c7a6889 and project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:26:23.453878 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Going to run 1 instances... {{(pid=118306) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:26:23.456146 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:26:23.589799 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-3c834ec4-8036-42ae-8f7f-748f49a4f126 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.666318 May 26 20:26:23.590384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 166/328] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:26:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 20:26:23.602639 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4929abe1-2527-4a13-9c43-739a8c3831a4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:23.603371 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4929abe1-2527-4a13-9c43-739a8c3831a4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:23.662132 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-4929abe1-2527-4a13-9c43-739a8c3831a4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:23.671177 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4929abe1-2527-4a13-9c43-739a8c3831a4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1242 microversion: 2.1 time: 0.073412 May 26 20:26:23.671177 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 163/329] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:23 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:24.688418 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-aff01135-a904-4e83-b7a6-3e0d94c95075 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:24.689032 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-aff01135-a904-4e83-b7a6-3e0d94c95075 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:24.695895 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-aff01135-a904-4e83-b7a6-3e0d94c95075 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:24.696343 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-aff01135-a904-4e83-b7a6-3e0d94c95075 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:24.697105 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-aff01135-a904-4e83-b7a6-3e0d94c95075 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:24.697539 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-aff01135-a904-4e83-b7a6-3e0d94c95075 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:24.757930 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-aff01135-a904-4e83-b7a6-3e0d94c95075 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:24.765298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-aff01135-a904-4e83-b7a6-3e0d94c95075 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1246 microversion: 2.1 time: 0.081191 May 26 20:26:24.765868 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 167/330] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:24 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:25.782781 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-38f2e47d-a126-4ccd-bc91-a9247f69952f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:25.783295 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-38f2e47d-a126-4ccd-bc91-a9247f69952f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:25.791388 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-38f2e47d-a126-4ccd-bc91-a9247f69952f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:25.791844 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-38f2e47d-a126-4ccd-bc91-a9247f69952f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:25.792592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-38f2e47d-a126-4ccd-bc91-a9247f69952f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:25.793019 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-38f2e47d-a126-4ccd-bc91-a9247f69952f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:25.853716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-38f2e47d-a126-4ccd-bc91-a9247f69952f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:25.861209 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-38f2e47d-a126-4ccd-bc91-a9247f69952f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1238 microversion: 2.1 time: 0.082589 May 26 20:26:25.861768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 164/331] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:25 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:26.879045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-507c7c52-7659-44af-953a-e8e33a83736a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:26.880280 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-507c7c52-7659-44af-953a-e8e33a83736a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:26.888420 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-507c7c52-7659-44af-953a-e8e33a83736a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:26.888882 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-507c7c52-7659-44af-953a-e8e33a83736a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:26.889720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-507c7c52-7659-44af-953a-e8e33a83736a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:26.890212 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-507c7c52-7659-44af-953a-e8e33a83736a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:26.963502 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-507c7c52-7659-44af-953a-e8e33a83736a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:26.972059 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-507c7c52-7659-44af-953a-e8e33a83736a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1300 microversion: 2.1 time: 0.097565 May 26 20:26:26.972657 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 168/332] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:26 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:27.993672 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7c93ba0d-84ef-415b-b1f6-3791575ade69 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:27.995046 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7c93ba0d-84ef-415b-b1f6-3791575ade69 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:28.001649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7c93ba0d-84ef-415b-b1f6-3791575ade69 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:28.002098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7c93ba0d-84ef-415b-b1f6-3791575ade69 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:28.002904 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7c93ba0d-84ef-415b-b1f6-3791575ade69 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:28.004379 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7c93ba0d-84ef-415b-b1f6-3791575ade69 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:28.175695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7c93ba0d-84ef-415b-b1f6-3791575ade69 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:28.183652 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7c93ba0d-84ef-415b-b1f6-3791575ade69 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1367 microversion: 2.1 time: 0.194797 May 26 20:26:28.184214 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 165/333] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:27 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:28.256651 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-6e82a73c-01a9-430d-b4c6-605b2575adfa req-584c9438-38c9-4b96-9eae-31db3f2dcda4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e33194d-abb0-4789-9dd9-7a0cf235852b", "tag": "360375bb-85b1-44dd-8e4f-7c8f582388b6"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:26:28.264211 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-6e82a73c-01a9-430d-b4c6-605b2575adfa req-584c9438-38c9-4b96-9eae-31db3f2dcda4 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:28.264930 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-6e82a73c-01a9-430d-b4c6-605b2575adfa req-584c9438-38c9-4b96-9eae-31db3f2dcda4 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:28.276571 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-6e82a73c-01a9-430d-b4c6-605b2575adfa req-584c9438-38c9-4b96-9eae-31db3f2dcda4 service nova] Creating event network-changed:360375bb-85b1-44dd-8e4f-7c8f582388b6 for instance 0e33194d-abb0-4789-9dd9-7a0cf235852b on hv-cinder-84213 May 26 20:26:28.288977 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-6e82a73c-01a9-430d-b4c6-605b2575adfa req-584c9438-38c9-4b96-9eae-31db3f2dcda4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044803 May 26 20:26:28.289738 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 169/334] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:26:29.201042 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b2ef8d6a-3161-4763-9d60-0f92977a6e55 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:29.201627 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b2ef8d6a-3161-4763-9d60-0f92977a6e55 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:29.208204 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2ef8d6a-3161-4763-9d60-0f92977a6e55 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:29.208657 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2ef8d6a-3161-4763-9d60-0f92977a6e55 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:29.209431 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2ef8d6a-3161-4763-9d60-0f92977a6e55 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:29.209875 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2ef8d6a-3161-4763-9d60-0f92977a6e55 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:29.340858 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b2ef8d6a-3161-4763-9d60-0f92977a6e55 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:29.348678 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b2ef8d6a-3161-4763-9d60-0f92977a6e55 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1367 microversion: 2.1 time: 0.152238 May 26 20:26:29.349247 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 166/335] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:29 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:30.366072 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9a66df6b-279c-4ebe-a1d2-dc98a71f4072 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:30.366836 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9a66df6b-279c-4ebe-a1d2-dc98a71f4072 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:30.373023 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9a66df6b-279c-4ebe-a1d2-dc98a71f4072 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:30.373473 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9a66df6b-279c-4ebe-a1d2-dc98a71f4072 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:30.374252 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9a66df6b-279c-4ebe-a1d2-dc98a71f4072 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:30.374694 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9a66df6b-279c-4ebe-a1d2-dc98a71f4072 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:30.517681 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9a66df6b-279c-4ebe-a1d2-dc98a71f4072 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:30.526658 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9a66df6b-279c-4ebe-a1d2-dc98a71f4072 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1367 microversion: 2.1 time: 0.165195 May 26 20:26:30.527895 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 170/336] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:30 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:31.547570 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6c0bb925-d702-44fc-88cf-692d79103cc4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:31.548182 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6c0bb925-d702-44fc-88cf-692d79103cc4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:31.555292 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c0bb925-d702-44fc-88cf-692d79103cc4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:31.555743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c0bb925-d702-44fc-88cf-692d79103cc4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:31.556507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c0bb925-d702-44fc-88cf-692d79103cc4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:31.556935 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c0bb925-d702-44fc-88cf-692d79103cc4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:31.693561 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6c0bb925-d702-44fc-88cf-692d79103cc4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:31.701526 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6c0bb925-d702-44fc-88cf-692d79103cc4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1367 microversion: 2.1 time: 0.157759 May 26 20:26:31.702098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 167/337] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:31 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:32.718988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-166924f7-ba74-4250-a3dc-158fa221706f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:32.719631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-166924f7-ba74-4250-a3dc-158fa221706f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:32.726432 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-166924f7-ba74-4250-a3dc-158fa221706f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:32.726876 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-166924f7-ba74-4250-a3dc-158fa221706f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:32.727629 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-166924f7-ba74-4250-a3dc-158fa221706f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:32.728055 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-166924f7-ba74-4250-a3dc-158fa221706f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:32.858073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-166924f7-ba74-4250-a3dc-158fa221706f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:32.865471 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-166924f7-ba74-4250-a3dc-158fa221706f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1367 microversion: 2.1 time: 0.150884 May 26 20:26:32.866040 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 171/338] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:32 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:33.888878 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-022ed9bf-b5b1-4ca8-98ca-0bcd5215905f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:33.888878 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-022ed9bf-b5b1-4ca8-98ca-0bcd5215905f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:33.888878 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:33.891514 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-022ed9bf-b5b1-4ca8-98ca-0bcd5215905f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:33.891964 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-022ed9bf-b5b1-4ca8-98ca-0bcd5215905f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:33.892717 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-022ed9bf-b5b1-4ca8-98ca-0bcd5215905f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:33.893147 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-022ed9bf-b5b1-4ca8-98ca-0bcd5215905f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:34.022883 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-022ed9bf-b5b1-4ca8-98ca-0bcd5215905f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:34.030282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-022ed9bf-b5b1-4ca8-98ca-0bcd5215905f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1367 microversion: 2.1 time: 0.151275 May 26 20:26:34.030854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 168/339] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:33 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:26:35.047586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ccd15378-b6cb-4376-bf9f-09e7cce84bb8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:35.048205 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ccd15378-b6cb-4376-bf9f-09e7cce84bb8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:35.050178 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:35.050865 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=10 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:35.056096 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ccd15378-b6cb-4376-bf9f-09e7cce84bb8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:35.056581 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ccd15378-b6cb-4376-bf9f-09e7cce84bb8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:35.057341 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ccd15378-b6cb-4376-bf9f-09e7cce84bb8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:35.057776 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ccd15378-b6cb-4376-bf9f-09e7cce84bb8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:35.198086 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ccd15378-b6cb-4376-bf9f-09e7cce84bb8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:35.206520 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ccd15378-b6cb-4376-bf9f-09e7cce84bb8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1367 microversion: 2.1 time: 0.162786 May 26 20:26:35.207246 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 172/340] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:35 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:36.201480 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-e9447a94-72c0-4a33-bb97-f5652d0218c8 req-2ef71f76-5cdd-45a1-ac48-b6e8d4d6de86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e33194d-abb0-4789-9dd9-7a0cf235852b", "name": "network-vif-plugged", "status": "completed", "tag": "360375bb-85b1-44dd-8e4f-7c8f582388b6"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:26:36.210150 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e9447a94-72c0-4a33-bb97-f5652d0218c8 req-2ef71f76-5cdd-45a1-ac48-b6e8d4d6de86 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:36.210655 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e9447a94-72c0-4a33-bb97-f5652d0218c8 req-2ef71f76-5cdd-45a1-ac48-b6e8d4d6de86 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:36.226570 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-e9447a94-72c0-4a33-bb97-f5652d0218c8 req-2ef71f76-5cdd-45a1-ac48-b6e8d4d6de86 service nova] Creating event network-vif-plugged:360375bb-85b1-44dd-8e4f-7c8f582388b6 for instance 0e33194d-abb0-4789-9dd9-7a0cf235852b on hv-cinder-84213 May 26 20:26:36.226853 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ab04f4f0-63e8-4848-815e-fc074cc50178 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:36.226853 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ab04f4f0-63e8-4848-815e-fc074cc50178 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:36.232381 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ab04f4f0-63e8-4848-815e-fc074cc50178 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:36.233036 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ab04f4f0-63e8-4848-815e-fc074cc50178 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:36.233996 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ab04f4f0-63e8-4848-815e-fc074cc50178 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:36.234453 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ab04f4f0-63e8-4848-815e-fc074cc50178 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:36.236335 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-e9447a94-72c0-4a33-bb97-f5652d0218c8 req-2ef71f76-5cdd-45a1-ac48-b6e8d4d6de86 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039126 May 26 20:26:36.237123 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 169/341] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:26:36.409972 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ab04f4f0-63e8-4848-815e-fc074cc50178 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:36.418995 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ab04f4f0-63e8-4848-815e-fc074cc50178 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1367 microversion: 2.1 time: 0.199644 May 26 20:26:36.419565 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 173/342] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:36 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:37.437527 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-95226b35-8c88-4e64-9a45-d79af9bf8be5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:37.438226 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-95226b35-8c88-4e64-9a45-d79af9bf8be5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:37.444410 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-95226b35-8c88-4e64-9a45-d79af9bf8be5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:37.444858 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-95226b35-8c88-4e64-9a45-d79af9bf8be5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:37.445614 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-95226b35-8c88-4e64-9a45-d79af9bf8be5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:37.446049 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-95226b35-8c88-4e64-9a45-d79af9bf8be5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:37.575567 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-95226b35-8c88-4e64-9a45-d79af9bf8be5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:37.582907 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-95226b35-8c88-4e64-9a45-d79af9bf8be5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1367 microversion: 2.1 time: 0.150831 May 26 20:26:37.583470 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 170/343] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:37 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:38.600352 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e64157c4-5aa5-4699-9d46-4f69f9246bfb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:38.600876 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e64157c4-5aa5-4699-9d46-4f69f9246bfb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:38.608545 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e64157c4-5aa5-4699-9d46-4f69f9246bfb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:38.608987 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e64157c4-5aa5-4699-9d46-4f69f9246bfb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:38.609911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e64157c4-5aa5-4699-9d46-4f69f9246bfb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:38.610452 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e64157c4-5aa5-4699-9d46-4f69f9246bfb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:38.745440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e64157c4-5aa5-4699-9d46-4f69f9246bfb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:38.752749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e64157c4-5aa5-4699-9d46-4f69f9246bfb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1367 microversion: 2.1 time: 0.156350 May 26 20:26:38.753322 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 174/344] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:38 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:39.769613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-303d2ea1-324d-4ae5-88f3-d01fed243020 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:39.770220 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-303d2ea1-324d-4ae5-88f3-d01fed243020 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:39.776723 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-303d2ea1-324d-4ae5-88f3-d01fed243020 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:39.777208 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-303d2ea1-324d-4ae5-88f3-d01fed243020 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:39.777959 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-303d2ea1-324d-4ae5-88f3-d01fed243020 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:39.778478 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-303d2ea1-324d-4ae5-88f3-d01fed243020 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:39.909082 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-303d2ea1-324d-4ae5-88f3-d01fed243020 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:39.916735 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-303d2ea1-324d-4ae5-88f3-d01fed243020 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1367 microversion: 2.1 time: 0.150959 May 26 20:26:39.918098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 171/345] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:39 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:40.933633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a05a3818-279b-42da-bbe5-44f99745cebe tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:40.934328 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a05a3818-279b-42da-bbe5-44f99745cebe tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:40.940735 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a05a3818-279b-42da-bbe5-44f99745cebe tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:40.943030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a05a3818-279b-42da-bbe5-44f99745cebe tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:40.943030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a05a3818-279b-42da-bbe5-44f99745cebe tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:40.943030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a05a3818-279b-42da-bbe5-44f99745cebe tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:41.076710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a05a3818-279b-42da-bbe5-44f99745cebe tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:41.084364 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a05a3818-279b-42da-bbe5-44f99745cebe tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1367 microversion: 2.1 time: 0.154583 May 26 20:26:41.084927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 175/346] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:40 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:42.102344 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e38b61ce-6857-4e69-b405-7df78cf2a8be tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:42.102959 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e38b61ce-6857-4e69-b405-7df78cf2a8be tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:42.109871 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e38b61ce-6857-4e69-b405-7df78cf2a8be tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:42.110349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e38b61ce-6857-4e69-b405-7df78cf2a8be tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:42.111113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e38b61ce-6857-4e69-b405-7df78cf2a8be tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:42.111550 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e38b61ce-6857-4e69-b405-7df78cf2a8be tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:42.239256 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e38b61ce-6857-4e69-b405-7df78cf2a8be tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:42.246777 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e38b61ce-6857-4e69-b405-7df78cf2a8be tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1555 microversion: 2.1 time: 0.148270 May 26 20:26:42.247352 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 172/347] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:42 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:42.263034 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b02ee488-0f88-443e-8fff-637fc6537c87 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:42.273803 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b02ee488-0f88-443e-8fff-637fc6537c87 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:42.273803 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b02ee488-0f88-443e-8fff-637fc6537c87 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:42.273803 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b02ee488-0f88-443e-8fff-637fc6537c87 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:42.273803 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b02ee488-0f88-443e-8fff-637fc6537c87 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:42.274181 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b02ee488-0f88-443e-8fff-637fc6537c87 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:42.348839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b02ee488-0f88-443e-8fff-637fc6537c87 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089711 May 26 20:26:42.349442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 176/348] 10.222.0.44 () {58 vars in 1274 bytes} [Thu May 26 20:26:42 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:26:43.526003 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-258bb40a-219c-432b-9160-e0e6ba06e14b req-12c24136-af6c-407e-ae71-018711a5a89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e33194d-abb0-4789-9dd9-7a0cf235852b", "tag": "360375bb-85b1-44dd-8e4f-7c8f582388b6"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:26:43.534473 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-258bb40a-219c-432b-9160-e0e6ba06e14b req-12c24136-af6c-407e-ae71-018711a5a89d service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:43.534920 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-258bb40a-219c-432b-9160-e0e6ba06e14b req-12c24136-af6c-407e-ae71-018711a5a89d service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:43.546620 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-258bb40a-219c-432b-9160-e0e6ba06e14b req-12c24136-af6c-407e-ae71-018711a5a89d service nova] Creating event network-changed:360375bb-85b1-44dd-8e4f-7c8f582388b6 for instance 0e33194d-abb0-4789-9dd9-7a0cf235852b on hv-cinder-84213 May 26 20:26:43.551532 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-258bb40a-219c-432b-9160-e0e6ba06e14b req-12c24136-af6c-407e-ae71-018711a5a89d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029244 May 26 20:26:43.552646 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 173/349] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:26:52.973737 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:52.974550 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=60 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:52.978670 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2580d3c0-733c-4c26-bc0c-6c25879fa21c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:52.979345 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2580d3c0-733c-4c26-bc0c-6c25879fa21c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:52.985937 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2580d3c0-733c-4c26-bc0c-6c25879fa21c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:52.986936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2580d3c0-733c-4c26-bc0c-6c25879fa21c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:52.987709 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2580d3c0-733c-4c26-bc0c-6c25879fa21c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:52.988143 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2580d3c0-733c-4c26-bc0c-6c25879fa21c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:53.116269 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-2580d3c0-733c-4c26-bc0c-6c25879fa21c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lazy-loading 'services' on Instance uuid 0c69e205-955e-4c96-a71f-65312359e1ef {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:26:53.376681 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2580d3c0-733c-4c26-bc0c-6c25879fa21c tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef/os-volume_attachments/529d0a81-831b-4d58-a5fa-c64d4e4224af" status: 202 len: 0 microversion: 2.1 time: 0.404292 May 26 20:26:53.377627 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 177/350] 10.222.0.44 () {58 vars in 1415 bytes} [Thu May 26 20:26:52 2022] DELETE /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef/os-volume_attachments/529d0a81-831b-4d58-a5fa-c64d4e4224af => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:26:53.776417 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=26 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:53.777165 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:53.781309 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-327848c2-2dd5-4aaf-830b-33e0068f7746 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:53.781882 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-327848c2-2dd5-4aaf-830b-33e0068f7746 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:53.788717 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-327848c2-2dd5-4aaf-830b-33e0068f7746 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:53.789168 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-327848c2-2dd5-4aaf-830b-33e0068f7746 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:53.789943 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-327848c2-2dd5-4aaf-830b-33e0068f7746 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:53.790411 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-327848c2-2dd5-4aaf-830b-33e0068f7746 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:53.913856 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-327848c2-2dd5-4aaf-830b-33e0068f7746 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lazy-loading 'services' on Instance uuid 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:26:54.192879 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-327848c2-2dd5-4aaf-830b-33e0068f7746 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/os-volume_attachments/2b530df0-4e12-48a7-8470-573a0288b532" status: 202 len: 0 microversion: 2.1 time: 0.417701 May 26 20:26:54.193592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 174/351] 10.222.0.44 () {58 vars in 1415 bytes} [Thu May 26 20:26:53 2022] DELETE /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/os-volume_attachments/2b530df0-4e12-48a7-8470-573a0288b532 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:26:54.494418 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-f5dc3d3f-caf3-4414-afc7-70162248dd5a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:54.495010 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-f5dc3d3f-caf3-4414-afc7-70162248dd5a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:54.501185 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f5dc3d3f-caf3-4414-afc7-70162248dd5a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:54.501634 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f5dc3d3f-caf3-4414-afc7-70162248dd5a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:54.503159 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f5dc3d3f-caf3-4414-afc7-70162248dd5a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:54.503608 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f5dc3d3f-caf3-4414-afc7-70162248dd5a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:54.528234 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-f5dc3d3f-caf3-4414-afc7-70162248dd5a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Going to try to terminate instance {{(pid=118306) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:26:54.850481 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-f5dc3d3f-caf3-4414-afc7-70162248dd5a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 204 len: 0 microversion: 2.1 time: 0.360309 May 26 20:26:54.850996 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 178/352] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:26:54 2022] DELETE /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:26:54.860201 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ba0b8627-4aff-46ae-b633-e1b755dc3af1 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:54.860902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ba0b8627-4aff-46ae-b633-e1b755dc3af1 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:54.872104 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba0b8627-4aff-46ae-b633-e1b755dc3af1 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:54.872552 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba0b8627-4aff-46ae-b633-e1b755dc3af1 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:54.873315 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba0b8627-4aff-46ae-b633-e1b755dc3af1 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:54.873752 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ba0b8627-4aff-46ae-b633-e1b755dc3af1 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:55.005713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ba0b8627-4aff-46ae-b633-e1b755dc3af1 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:55.013221 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ba0b8627-4aff-46ae-b633-e1b755dc3af1 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1513 microversion: 2.1 time: 0.157605 May 26 20:26:55.013784 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 175/353] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:54 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:56.031428 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c37c69d9-01a8-4f5c-84c8-135f7f54075a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:56.032128 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c37c69d9-01a8-4f5c-84c8-135f7f54075a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:56.039172 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c37c69d9-01a8-4f5c-84c8-135f7f54075a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:56.039619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c37c69d9-01a8-4f5c-84c8-135f7f54075a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:56.040380 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c37c69d9-01a8-4f5c-84c8-135f7f54075a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:56.040809 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c37c69d9-01a8-4f5c-84c8-135f7f54075a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:56.172228 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c37c69d9-01a8-4f5c-84c8-135f7f54075a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:56.180558 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c37c69d9-01a8-4f5c-84c8-135f7f54075a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1513 microversion: 2.1 time: 0.153399 May 26 20:26:56.181116 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 179/354] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:56 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:57.197721 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3b641f65-3fdd-41df-9218-9fc01fa780ff tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:57.198670 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3b641f65-3fdd-41df-9218-9fc01fa780ff tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:57.205323 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b641f65-3fdd-41df-9218-9fc01fa780ff tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:57.205782 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b641f65-3fdd-41df-9218-9fc01fa780ff tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:57.206610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b641f65-3fdd-41df-9218-9fc01fa780ff tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:57.207588 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b641f65-3fdd-41df-9218-9fc01fa780ff tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:57.394930 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-3b641f65-3fdd-41df-9218-9fc01fa780ff tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:57.402936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3b641f65-3fdd-41df-9218-9fc01fa780ff tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1513 microversion: 2.1 time: 0.209259 May 26 20:26:57.403613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 176/355] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:57 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:57.424919 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-444fb792-8fec-488c-8bf9-9dd8f97b4d01 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:26:57.432242 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-444fb792-8fec-488c-8bf9-9dd8f97b4d01 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:57.432685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-444fb792-8fec-488c-8bf9-9dd8f97b4d01 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:57.455503 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-444fb792-8fec-488c-8bf9-9dd8f97b4d01 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Going to try to stop instance {{(pid=118306) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 20:26:57.550530 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-e686adba-9dd3-484f-b68f-f37290634feb req-51676af8-e91d-4577-a970-d071090b3951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c69e205-955e-4c96-a71f-65312359e1ef", "name": "network-vif-deleted", "tag": "0e7c45b2-ac4a-4edd-ad28-0ba8e6a560c5"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:26:57.560025 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e686adba-9dd3-484f-b68f-f37290634feb req-51676af8-e91d-4577-a970-d071090b3951 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:57.560495 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e686adba-9dd3-484f-b68f-f37290634feb req-51676af8-e91d-4577-a970-d071090b3951 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:57.572203 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-e686adba-9dd3-484f-b68f-f37290634feb req-51676af8-e91d-4577-a970-d071090b3951 service nova] Creating event network-vif-deleted:0e7c45b2-ac4a-4edd-ad28-0ba8e6a560c5 for instance 0c69e205-955e-4c96-a71f-65312359e1ef on hv-cinder-84213 May 26 20:26:57.577247 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-e686adba-9dd3-484f-b68f-f37290634feb req-51676af8-e91d-4577-a970-d071090b3951 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030296 May 26 20:26:57.577861 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 177/356] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:26:57.617090 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-444fb792-8fec-488c-8bf9-9dd8f97b4d01 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "POST /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/action" status: 202 len: 0 microversion: 2.1 time: 0.195920 May 26 20:26:57.617721 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 180/357] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:26:57 2022] POST /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:26:57.626452 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f45a94f3-e12a-4ca1-98b8-413874d26341 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:57.627153 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f45a94f3-e12a-4ca1-98b8-413874d26341 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:57.634188 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f45a94f3-e12a-4ca1-98b8-413874d26341 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:57.634672 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f45a94f3-e12a-4ca1-98b8-413874d26341 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:57.635440 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f45a94f3-e12a-4ca1-98b8-413874d26341 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:57.635897 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f45a94f3-e12a-4ca1-98b8-413874d26341 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:57.777409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f45a94f3-e12a-4ca1-98b8-413874d26341 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:57.787373 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f45a94f3-e12a-4ca1-98b8-413874d26341 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.165279 May 26 20:26:57.787954 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 178/358] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:57 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:58.421435 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-57a025a9-e0b4-4b64-bbfe-403fdf8cd462 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:58.422259 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-57a025a9-e0b4-4b64-bbfe-403fdf8cd462 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:58.430615 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-57a025a9-e0b4-4b64-bbfe-403fdf8cd462 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:58.431933 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-57a025a9-e0b4-4b64-bbfe-403fdf8cd462 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:58.432705 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-57a025a9-e0b4-4b64-bbfe-403fdf8cd462 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:58.433151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-57a025a9-e0b4-4b64-bbfe-403fdf8cd462 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:58.472073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-57a025a9-e0b4-4b64-bbfe-403fdf8cd462 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:58.472555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-57a025a9-e0b4-4b64-bbfe-403fdf8cd462 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:58.473003 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-57a025a9-e0b4-4b64-bbfe-403fdf8cd462 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lazy-loading 'fault' on Instance uuid 0c69e205-955e-4c96-a71f-65312359e1ef {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:26:58.514282 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-57a025a9-e0b4-4b64-bbfe-403fdf8cd462 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:58.522302 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-57a025a9-e0b4-4b64-bbfe-403fdf8cd462 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 200 len: 1309 microversion: 2.1 time: 0.105051 May 26 20:26:58.522870 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 181/359] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:58 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:26:58.805816 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-42733734-298d-4c1b-8977-db8d9d9ae728 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:58.806447 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-42733734-298d-4c1b-8977-db8d9d9ae728 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:58.812919 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-42733734-298d-4c1b-8977-db8d9d9ae728 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:58.813364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-42733734-298d-4c1b-8977-db8d9d9ae728 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:58.814117 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-42733734-298d-4c1b-8977-db8d9d9ae728 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:58.814668 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-42733734-298d-4c1b-8977-db8d9d9ae728 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:58.945284 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-42733734-298d-4c1b-8977-db8d9d9ae728 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:26:58.952759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-42733734-298d-4c1b-8977-db8d9d9ae728 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.150904 May 26 20:26:58.953321 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 179/360] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:58 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:26:59.539835 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8abedbfa-9b4c-437b-840b-5e7bfaa55c94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:59.540449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8abedbfa-9b4c-437b-840b-5e7bfaa55c94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 0c69e205-955e-4c96-a71f-65312359e1ef] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:59.546867 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8abedbfa-9b4c-437b-840b-5e7bfaa55c94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:59.547318 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8abedbfa-9b4c-437b-840b-5e7bfaa55c94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:59.548076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8abedbfa-9b4c-437b-840b-5e7bfaa55c94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:59.548510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8abedbfa-9b4c-437b-840b-5e7bfaa55c94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:59.562171 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-8abedbfa-9b4c-437b-840b-5e7bfaa55c94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] HTTP exception thrown: Instance 0c69e205-955e-4c96-a71f-65312359e1ef could not be found. May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8abedbfa-9b4c-437b-840b-5e7bfaa55c94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Request method failure captured: May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef HTTP/1.1 May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-I2I1F7QMkBJ6SWuarWlk80k3P-yoZO_YeRqStKUk0XsVekJqHMUJVbvPHjiukFVloUGlnHLvctd071bpV4l9uz_PEWdpEuZt8bqoDA_wTpz3SecjxITj2epBV0Q93OhgI727L2sXfZk5H3VIkmrRW3aHcIVU8O8PWPKJwGnMn09rQ May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: c7deb3c965bb427eb4a9753cd21bca05 May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-VolumesSnapshotTestJSON-345106894 May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:26:59.563823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:26:59.565383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c7deb3c965bb427eb4a9753cd21bca05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c7deb3c965bb427eb4a9753cd21bca05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c7deb3c965bb427eb4a9753cd21bca05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c7deb3c965bb427eb4a9753cd21bca05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:26:59.565383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-VolumesSnapshotTestJSON-345106894 May 26 20:26:59.565383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: c7deb3c965bb427eb4a9753cd21bca05 May 26 20:26:59.565383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-345106894 May 26 20:26:59.565383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-VolumesSnapshotTestJSON-345106894-project May 26 20:26:59.565383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:26:59.565383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:26:59.565383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: d005cfcbb5e04a1084857e89a42921f9 May 26 20:26:59.565383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-VolumesSnapshotTestJSON-345106894-project May 26 20:26:59.565383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:26:59.565383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 0c69e205-955e-4c96-a71f-65312359e1ef could not be found. May 26 20:26:59.565383 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '0c69e205-955e-4c96-a71f-65312359e1ef'} May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c69e205-955e-4c96-a71f-65312359e1ef could not be found. May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:26:59.566311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c69e205-955e-4c96-a71f-65312359e1ef could not be found. May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c69e205-955e-4c96-a71f-65312359e1ef could not be found. May 26 20:26:59.571779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:26:59.573059 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8abedbfa-9b4c-437b-840b-5e7bfaa55c94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Returning 404 to user: Instance 0c69e205-955e-4c96-a71f-65312359e1ef could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:26:59.573059 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8abedbfa-9b4c-437b-840b-5e7bfaa55c94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef" status: 404 len: 111 microversion: 2.1 time: 0.029445 May 26 20:26:59.573059 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 182/361] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:59 2022] GET /compute/v2.1/servers/0c69e205-955e-4c96-a71f-65312359e1ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:26:59.970119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c30802f1-a96a-4da5-a272-406ddb7b90a3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:26:59.970759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c30802f1-a96a-4da5-a272-406ddb7b90a3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:26:59.978334 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c30802f1-a96a-4da5-a272-406ddb7b90a3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:59.978788 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c30802f1-a96a-4da5-a272-406ddb7b90a3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:26:59.979552 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c30802f1-a96a-4da5-a272-406ddb7b90a3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:26:59.981553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c30802f1-a96a-4da5-a272-406ddb7b90a3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:00.125576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c30802f1-a96a-4da5-a272-406ddb7b90a3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:00.135680 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c30802f1-a96a-4da5-a272-406ddb7b90a3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.169519 May 26 20:27:00.136280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 180/362] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:26:59 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:01.152665 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a85e4cde-5ec5-4f0c-bbb1-e445e608ff37 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:01.153264 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a85e4cde-5ec5-4f0c-bbb1-e445e608ff37 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:01.160034 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a85e4cde-5ec5-4f0c-bbb1-e445e608ff37 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:01.160430 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a85e4cde-5ec5-4f0c-bbb1-e445e608ff37 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:01.161274 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a85e4cde-5ec5-4f0c-bbb1-e445e608ff37 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:01.161725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a85e4cde-5ec5-4f0c-bbb1-e445e608ff37 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:01.287945 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a85e4cde-5ec5-4f0c-bbb1-e445e608ff37 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:01.295388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a85e4cde-5ec5-4f0c-bbb1-e445e608ff37 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.146520 May 26 20:27:01.296004 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 183/363] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:01 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:01.367589 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5c774e4f-0882-4e73-8792-1303a34e954d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbb26693-7525-40c6-9fab-b92ad7ba86b8"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:01.368644 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5c774e4f-0882-4e73-8792-1303a34e954d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:01.375375 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c774e4f-0882-4e73-8792-1303a34e954d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:01.375887 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c774e4f-0882-4e73-8792-1303a34e954d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:01.376651 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c774e4f-0882-4e73-8792-1303a34e954d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:01.377087 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5c774e4f-0882-4e73-8792-1303a34e954d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:02.312857 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4a62146b-c819-4da1-87a6-fc92b0459abd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:02.313420 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4a62146b-c819-4da1-87a6-fc92b0459abd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:02.320420 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4a62146b-c819-4da1-87a6-fc92b0459abd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:02.320859 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4a62146b-c819-4da1-87a6-fc92b0459abd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:02.321612 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4a62146b-c819-4da1-87a6-fc92b0459abd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:02.322039 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4a62146b-c819-4da1-87a6-fc92b0459abd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:02.451896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4a62146b-c819-4da1-87a6-fc92b0459abd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:02.459987 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4a62146b-c819-4da1-87a6-fc92b0459abd tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.151034 May 26 20:27:02.460545 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 184/364] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:02 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:03.478090 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-14f7dad0-3943-4409-8c88-cd06710ed1ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:03.478817 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-14f7dad0-3943-4409-8c88-cd06710ed1ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:03.485374 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-14f7dad0-3943-4409-8c88-cd06710ed1ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:03.485822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-14f7dad0-3943-4409-8c88-cd06710ed1ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:03.486655 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-14f7dad0-3943-4409-8c88-cd06710ed1ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:03.487083 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-14f7dad0-3943-4409-8c88-cd06710ed1ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:03.614272 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-14f7dad0-3943-4409-8c88-cd06710ed1ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:03.621896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-14f7dad0-3943-4409-8c88-cd06710ed1ad tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.148517 May 26 20:27:03.626983 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 185/365] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:03 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:03.702144 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5c774e4f-0882-4e73-8792-1303a34e954d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "POST /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.339502 May 26 20:27:03.702833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 181/366] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:27:01 2022] POST /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments => generated 194 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:27:04.638981 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e12cf99e-af9a-4c91-b07b-4567d56bdae7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:04.639508 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e12cf99e-af9a-4c91-b07b-4567d56bdae7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:04.646067 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e12cf99e-af9a-4c91-b07b-4567d56bdae7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:04.648948 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e12cf99e-af9a-4c91-b07b-4567d56bdae7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:04.648948 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e12cf99e-af9a-4c91-b07b-4567d56bdae7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:04.648948 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e12cf99e-af9a-4c91-b07b-4567d56bdae7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:04.777550 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e12cf99e-af9a-4c91-b07b-4567d56bdae7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:04.785137 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e12cf99e-af9a-4c91-b07b-4567d56bdae7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.150048 May 26 20:27:04.785699 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 186/367] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:04 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:05.804007 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9292e3a0-8220-4bae-a081-212cdaf1a1de tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:05.804890 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9292e3a0-8220-4bae-a081-212cdaf1a1de tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:05.811109 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9292e3a0-8220-4bae-a081-212cdaf1a1de tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:05.811559 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9292e3a0-8220-4bae-a081-212cdaf1a1de tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:05.812317 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9292e3a0-8220-4bae-a081-212cdaf1a1de tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:05.812751 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9292e3a0-8220-4bae-a081-212cdaf1a1de tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:05.976000 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9292e3a0-8220-4bae-a081-212cdaf1a1de tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:05.976000 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9292e3a0-8220-4bae-a081-212cdaf1a1de tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.154449 May 26 20:27:05.976000 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 182/368] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:05 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:06.971412 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a3514746-1e3e-4878-a549-30aae224d552 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:06.972109 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a3514746-1e3e-4878-a549-30aae224d552 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:06.978982 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a3514746-1e3e-4878-a549-30aae224d552 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:06.979341 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a3514746-1e3e-4878-a549-30aae224d552 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:06.980111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a3514746-1e3e-4878-a549-30aae224d552 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:06.980550 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a3514746-1e3e-4878-a549-30aae224d552 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:07.111231 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a3514746-1e3e-4878-a549-30aae224d552 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:07.119420 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a3514746-1e3e-4878-a549-30aae224d552 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.151794 May 26 20:27:07.119983 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 187/369] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:06 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:08.137287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f06fa8fd-2d16-431d-9a92-fc2f83670345 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:08.137881 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f06fa8fd-2d16-431d-9a92-fc2f83670345 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:08.144529 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f06fa8fd-2d16-431d-9a92-fc2f83670345 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:08.145172 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f06fa8fd-2d16-431d-9a92-fc2f83670345 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:08.145948 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f06fa8fd-2d16-431d-9a92-fc2f83670345 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:08.146719 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f06fa8fd-2d16-431d-9a92-fc2f83670345 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:08.287408 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f06fa8fd-2d16-431d-9a92-fc2f83670345 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:08.295425 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f06fa8fd-2d16-431d-9a92-fc2f83670345 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.162893 May 26 20:27:08.295990 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 183/370] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:08 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:09.312621 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b3da82dd-a058-4518-a83f-95586d9d9db0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:09.313221 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b3da82dd-a058-4518-a83f-95586d9d9db0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:09.320231 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b3da82dd-a058-4518-a83f-95586d9d9db0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:09.320691 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b3da82dd-a058-4518-a83f-95586d9d9db0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:09.321443 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b3da82dd-a058-4518-a83f-95586d9d9db0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:09.321870 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b3da82dd-a058-4518-a83f-95586d9d9db0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:09.455588 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b3da82dd-a058-4518-a83f-95586d9d9db0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:09.466148 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b3da82dd-a058-4518-a83f-95586d9d9db0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.157222 May 26 20:27:09.467298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 188/371] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:09 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:10.135952 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1058794294", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "networks": [{"uuid": "2a782230-6255-4dbb-88c7-2bfd62746d19"}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:10.190663 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] validate_networks() for [('2a782230-6255-4dbb-88c7-2bfd62746d19', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:27:10.484401 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b68dd644-14f4-4702-a354-d101ed743971 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:10.485015 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b68dd644-14f4-4702-a354-d101ed743971 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:10.492143 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b68dd644-14f4-4702-a354-d101ed743971 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:10.492684 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b68dd644-14f4-4702-a354-d101ed743971 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:10.493455 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b68dd644-14f4-4702-a354-d101ed743971 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:10.493888 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b68dd644-14f4-4702-a354-d101ed743971 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:10.543101 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:27:10.543526 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:27:10.543996 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:27:10.544445 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:27:10.544887 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:27:10.554642 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:10.555349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:10.556093 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:10.556598 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:10.573236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Getting quotas for project c7deb3c965bb427eb4a9753cd21bca05. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:27:10.577395 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Getting quotas for user d005cfcbb5e04a1084857e89a42921f9 and project c7deb3c965bb427eb4a9753cd21bca05. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:27:10.588920 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:27:10.591719 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:27:10.629261 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b68dd644-14f4-4702-a354-d101ed743971 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:10.636921 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b68dd644-14f4-4702-a354-d101ed743971 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.156481 May 26 20:27:10.637487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 189/372] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:10 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:10.732069 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6c68986f-2a13-4e9a-8bd9-2913909842b4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600154 May 26 20:27:10.732639 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 184/373] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:27:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:27:10.742820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b38da07e-3a4b-4ab4-9096-d0b23d9c62e5 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:10.743431 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b38da07e-3a4b-4ab4-9096-d0b23d9c62e5 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:10.798523 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b38da07e-3a4b-4ab4-9096-d0b23d9c62e5 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:10.806548 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b38da07e-3a4b-4ab4-9096-d0b23d9c62e5 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1219 microversion: 2.1 time: 0.067679 May 26 20:27:10.807829 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 190/374] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:10 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:11.655226 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-db37ef7c-a5a9-42e7-9005-c212014454ee tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:11.655953 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-db37ef7c-a5a9-42e7-9005-c212014454ee tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:11.662886 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db37ef7c-a5a9-42e7-9005-c212014454ee tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:11.663332 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db37ef7c-a5a9-42e7-9005-c212014454ee tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:11.664227 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db37ef7c-a5a9-42e7-9005-c212014454ee tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:11.664713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-db37ef7c-a5a9-42e7-9005-c212014454ee tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:11.801423 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-db37ef7c-a5a9-42e7-9005-c212014454ee tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:11.809719 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-db37ef7c-a5a9-42e7-9005-c212014454ee tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.159107 May 26 20:27:11.811297 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 185/375] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:11 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:11.824333 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8e431955-23d9-46ad-b6ad-2127188ec44d tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:11.824951 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8e431955-23d9-46ad-b6ad-2127188ec44d tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:11.832219 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8e431955-23d9-46ad-b6ad-2127188ec44d tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:11.832896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8e431955-23d9-46ad-b6ad-2127188ec44d tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:11.833671 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8e431955-23d9-46ad-b6ad-2127188ec44d tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:11.834109 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8e431955-23d9-46ad-b6ad-2127188ec44d tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:11.854128 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:11.906861 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8e431955-23d9-46ad-b6ad-2127188ec44d tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:11.909138 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8e431955-23d9-46ad-b6ad-2127188ec44d tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1215 microversion: 2.1 time: 0.089533 May 26 20:27:11.910053 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 191/376] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:11 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:12.827462 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1c810844-4496-4a66-aa91-ffefa0c2f3c4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:12.828010 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1c810844-4496-4a66-aa91-ffefa0c2f3c4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:12.834865 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1c810844-4496-4a66-aa91-ffefa0c2f3c4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:12.835321 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1c810844-4496-4a66-aa91-ffefa0c2f3c4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:12.836119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1c810844-4496-4a66-aa91-ffefa0c2f3c4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:12.837264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1c810844-4496-4a66-aa91-ffefa0c2f3c4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:12.926988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e8e4d995-1850-4ce0-b893-f09fce63a625 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:12.927596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e8e4d995-1850-4ce0-b893-f09fce63a625 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:12.935332 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e8e4d995-1850-4ce0-b893-f09fce63a625 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:12.935780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e8e4d995-1850-4ce0-b893-f09fce63a625 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:12.936539 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e8e4d995-1850-4ce0-b893-f09fce63a625 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:12.936966 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e8e4d995-1850-4ce0-b893-f09fce63a625 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:12.972610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-1c810844-4496-4a66-aa91-ffefa0c2f3c4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:12.981410 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1c810844-4496-4a66-aa91-ffefa0c2f3c4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.157885 May 26 20:27:12.982299 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 186/377] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:12 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:13.015527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e8e4d995-1850-4ce0-b893-f09fce63a625 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:13.024462 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e8e4d995-1850-4ce0-b893-f09fce63a625 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1271 microversion: 2.1 time: 0.101172 May 26 20:27:13.025523 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 192/378] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:12 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:13.499585 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-df728ba9-9a6c-4b69-9ad7-39fdd5f6aa62 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:13.500594 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-df728ba9-9a6c-4b69-9ad7-39fdd5f6aa62 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:13.506647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df728ba9-9a6c-4b69-9ad7-39fdd5f6aa62 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:13.507094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df728ba9-9a6c-4b69-9ad7-39fdd5f6aa62 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:13.508075 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df728ba9-9a6c-4b69-9ad7-39fdd5f6aa62 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:13.509086 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df728ba9-9a6c-4b69-9ad7-39fdd5f6aa62 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:13.533830 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-df728ba9-9a6c-4b69-9ad7-39fdd5f6aa62 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lazy-loading 'flavor' on Instance uuid 6602854b-bca1-47cb-9307-9e01ce9e96d7 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:27:13.826054 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:13.920230 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-df728ba9-9a6c-4b69-9ad7-39fdd5f6aa62 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "POST /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/action" status: 200 len: 32 microversion: 2.1 time: 0.424596 May 26 20:27:13.920953 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 187/379] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:27:13 2022] POST /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/action => generated 32 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 20:27:13.930843 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5175a741-c30b-4787-bee1-1f66cac691be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:13.936361 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5175a741-c30b-4787-bee1-1f66cac691be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:13.938122 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5175a741-c30b-4787-bee1-1f66cac691be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:13.938603 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5175a741-c30b-4787-bee1-1f66cac691be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:13.939386 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5175a741-c30b-4787-bee1-1f66cac691be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:13.939816 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5175a741-c30b-4787-bee1-1f66cac691be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:14.000515 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5b84b7fb-73d0-4a03-8b28-e7431c6588e7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:14.001225 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5b84b7fb-73d0-4a03-8b28-e7431c6588e7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:14.008311 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5b84b7fb-73d0-4a03-8b28-e7431c6588e7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:14.010139 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5b84b7fb-73d0-4a03-8b28-e7431c6588e7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:14.011092 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5b84b7fb-73d0-4a03-8b28-e7431c6588e7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:14.011396 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5b84b7fb-73d0-4a03-8b28-e7431c6588e7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:14.080387 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5175a741-c30b-4787-bee1-1f66cac691be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:14.091948 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5175a741-c30b-4787-bee1-1f66cac691be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.165277 May 26 20:27:14.092534 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 193/380] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:13 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:14.097222 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4cb44622-8596-4c62-8866-13bd46508d88 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:14.098012 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4cb44622-8596-4c62-8866-13bd46508d88 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:14.104682 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4cb44622-8596-4c62-8866-13bd46508d88 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:14.105125 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4cb44622-8596-4c62-8866-13bd46508d88 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:14.105909 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4cb44622-8596-4c62-8866-13bd46508d88 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:14.106385 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4cb44622-8596-4c62-8866-13bd46508d88 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:14.254866 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4cb44622-8596-4c62-8866-13bd46508d88 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:14.266026 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4cb44622-8596-4c62-8866-13bd46508d88 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1319 microversion: 2.1 time: 0.172224 May 26 20:27:14.266772 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 194/381] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:14 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:14.360000 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5b84b7fb-73d0-4a03-8b28-e7431c6588e7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:14.368809 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5b84b7fb-73d0-4a03-8b28-e7431c6588e7 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1676 microversion: 2.1 time: 0.371837 May 26 20:27:14.369806 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 188/382] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:13 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1676 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:15.109757 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8ab860b3-df09-4155-beb6-fbe66871ca3c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:15.110484 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8ab860b3-df09-4155-beb6-fbe66871ca3c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:15.116579 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ab860b3-df09-4155-beb6-fbe66871ca3c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:15.117022 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ab860b3-df09-4155-beb6-fbe66871ca3c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:15.118392 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ab860b3-df09-4155-beb6-fbe66871ca3c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:15.119106 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ab860b3-df09-4155-beb6-fbe66871ca3c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:15.259274 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8ab860b3-df09-4155-beb6-fbe66871ca3c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:15.267340 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8ab860b3-df09-4155-beb6-fbe66871ca3c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.162014 May 26 20:27:15.267910 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 195/383] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:15 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:15.292925 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-26ce4b88-b092-4460-915f-837a3c980b84 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:15.293647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-26ce4b88-b092-4460-915f-837a3c980b84 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:15.300361 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-26ce4b88-b092-4460-915f-837a3c980b84 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:15.302726 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-26ce4b88-b092-4460-915f-837a3c980b84 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:15.302726 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-26ce4b88-b092-4460-915f-837a3c980b84 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:15.302726 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-26ce4b88-b092-4460-915f-837a3c980b84 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:15.386668 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9f6ca31e-8a8c-451f-b3ac-e2a53cfdd03e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:15.387275 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9f6ca31e-8a8c-451f-b3ac-e2a53cfdd03e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:15.393317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9f6ca31e-8a8c-451f-b3ac-e2a53cfdd03e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:15.396672 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9f6ca31e-8a8c-451f-b3ac-e2a53cfdd03e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:15.396672 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9f6ca31e-8a8c-451f-b3ac-e2a53cfdd03e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:15.396672 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9f6ca31e-8a8c-451f-b3ac-e2a53cfdd03e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:15.455265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-26ce4b88-b092-4460-915f-837a3c980b84 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:15.465343 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-26ce4b88-b092-4460-915f-837a3c980b84 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1319 microversion: 2.1 time: 0.177113 May 26 20:27:15.466091 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 189/384] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:15 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:15.520829 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-de844d32-9876-49e8-85c7-586d071a01be req-70814db5-31b0-4d51-9dff-bb23d573f473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b85b88-9a19-473d-a08a-07d3a471dacc", "tag": "04e52dc1-16de-4010-be95-99bce2c747aa"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:15.530009 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-de844d32-9876-49e8-85c7-586d071a01be req-70814db5-31b0-4d51-9dff-bb23d573f473 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:15.530511 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-de844d32-9876-49e8-85c7-586d071a01be req-70814db5-31b0-4d51-9dff-bb23d573f473 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:15.542519 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-de844d32-9876-49e8-85c7-586d071a01be req-70814db5-31b0-4d51-9dff-bb23d573f473 service nova] Creating event network-changed:04e52dc1-16de-4010-be95-99bce2c747aa for instance 48b85b88-9a19-473d-a08a-07d3a471dacc on hv-cinder-84213 May 26 20:27:15.547403 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-de844d32-9876-49e8-85c7-586d071a01be req-70814db5-31b0-4d51-9dff-bb23d573f473 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030215 May 26 20:27:15.551580 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 190/385] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:27:15.551857 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9f6ca31e-8a8c-451f-b3ac-e2a53cfdd03e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:15.560349 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9f6ca31e-8a8c-451f-b3ac-e2a53cfdd03e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1653 microversion: 2.1 time: 0.177539 May 26 20:27:15.561025 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 196/386] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:15 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1653 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:15.578663 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e5e1c0fb-9247-4802-a78c-aa379b8fec64 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:15.589335 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e5e1c0fb-9247-4802-a78c-aa379b8fec64 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:15.589883 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e5e1c0fb-9247-4802-a78c-aa379b8fec64 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:15.613213 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e5e1c0fb-9247-4802-a78c-aa379b8fec64 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Going to try to start instance {{(pid=118307) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 20:27:15.781266 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e5e1c0fb-9247-4802-a78c-aa379b8fec64 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "POST /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/action" status: 202 len: 0 microversion: 2.1 time: 0.206861 May 26 20:27:15.781942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 191/387] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:27:15 2022] POST /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:27:15.789986 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8fe2ac68-8109-4c36-8a4a-90cecf36e179 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:15.790772 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8fe2ac68-8109-4c36-8a4a-90cecf36e179 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:15.797517 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8fe2ac68-8109-4c36-8a4a-90cecf36e179 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:15.798178 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8fe2ac68-8109-4c36-8a4a-90cecf36e179 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:15.798978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8fe2ac68-8109-4c36-8a4a-90cecf36e179 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:15.799408 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8fe2ac68-8109-4c36-8a4a-90cecf36e179 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:15.958402 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8fe2ac68-8109-4c36-8a4a-90cecf36e179 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:15.966916 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8fe2ac68-8109-4c36-8a4a-90cecf36e179 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1662 microversion: 2.1 time: 0.180399 May 26 20:27:15.967530 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 197/388] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:15 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1662 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:16.285870 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-88a3284a-bd15-47fc-a796-64672bd16655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:16.286601 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-88a3284a-bd15-47fc-a796-64672bd16655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:16.294734 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88a3284a-bd15-47fc-a796-64672bd16655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:16.295434 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88a3284a-bd15-47fc-a796-64672bd16655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:16.296050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88a3284a-bd15-47fc-a796-64672bd16655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:16.296490 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88a3284a-bd15-47fc-a796-64672bd16655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:16.485043 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-04728e1a-b7ad-4567-a082-c1db8f2efa6e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:16.485916 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-04728e1a-b7ad-4567-a082-c1db8f2efa6e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:16.500864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-04728e1a-b7ad-4567-a082-c1db8f2efa6e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:16.501854 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-04728e1a-b7ad-4567-a082-c1db8f2efa6e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:16.502649 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-04728e1a-b7ad-4567-a082-c1db8f2efa6e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:16.503087 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-04728e1a-b7ad-4567-a082-c1db8f2efa6e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:16.639447 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-04728e1a-b7ad-4567-a082-c1db8f2efa6e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:16.647368 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-04728e1a-b7ad-4567-a082-c1db8f2efa6e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1319 microversion: 2.1 time: 0.166658 May 26 20:27:16.647920 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 198/389] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:16 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:16.750833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-88a3284a-bd15-47fc-a796-64672bd16655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:16.758770 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-88a3284a-bd15-47fc-a796-64672bd16655 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.477318 May 26 20:27:16.759339 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 192/390] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:16 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:16.983957 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-20f67b13-68fb-4047-86cf-0f7e4f2b67fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:16.984599 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-20f67b13-68fb-4047-86cf-0f7e4f2b67fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:16.991118 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-20f67b13-68fb-4047-86cf-0f7e4f2b67fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:16.991566 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-20f67b13-68fb-4047-86cf-0f7e4f2b67fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:16.992319 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-20f67b13-68fb-4047-86cf-0f7e4f2b67fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:16.993321 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-20f67b13-68fb-4047-86cf-0f7e4f2b67fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:17.125463 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-20f67b13-68fb-4047-86cf-0f7e4f2b67fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:17.133033 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-20f67b13-68fb-4047-86cf-0f7e4f2b67fa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1662 microversion: 2.1 time: 0.152819 May 26 20:27:17.134161 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 199/391] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:16 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:17.664217 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1eeb65f2-e3ba-4876-b497-f141abad359e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:17.664836 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1eeb65f2-e3ba-4876-b497-f141abad359e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:17.671788 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1eeb65f2-e3ba-4876-b497-f141abad359e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:17.672240 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1eeb65f2-e3ba-4876-b497-f141abad359e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:17.673018 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1eeb65f2-e3ba-4876-b497-f141abad359e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:17.673460 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1eeb65f2-e3ba-4876-b497-f141abad359e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:17.776977 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4757969e-505d-40dd-8b65-7ce63db7deba tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:17.777597 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4757969e-505d-40dd-8b65-7ce63db7deba tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:17.784583 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4757969e-505d-40dd-8b65-7ce63db7deba tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:17.784583 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4757969e-505d-40dd-8b65-7ce63db7deba tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:17.784840 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4757969e-505d-40dd-8b65-7ce63db7deba tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:17.785285 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4757969e-505d-40dd-8b65-7ce63db7deba tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:17.808580 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-1eeb65f2-e3ba-4876-b497-f141abad359e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:17.816152 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1eeb65f2-e3ba-4876-b497-f141abad359e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1319 microversion: 2.1 time: 0.155749 May 26 20:27:17.816714 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 193/392] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:17 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:17.925257 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4757969e-505d-40dd-8b65-7ce63db7deba tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:17.934129 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4757969e-505d-40dd-8b65-7ce63db7deba tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.161569 May 26 20:27:17.934731 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 200/393] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:17 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:18.151621 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-08eaa718-6633-4c76-a748-482c073b4ca5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:18.152267 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-08eaa718-6633-4c76-a748-482c073b4ca5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:18.158317 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-08eaa718-6633-4c76-a748-482c073b4ca5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:18.158771 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-08eaa718-6633-4c76-a748-482c073b4ca5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:18.159539 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-08eaa718-6633-4c76-a748-482c073b4ca5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:18.159974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-08eaa718-6633-4c76-a748-482c073b4ca5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:18.296327 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-08eaa718-6633-4c76-a748-482c073b4ca5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:18.303865 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-08eaa718-6633-4c76-a748-482c073b4ca5 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1662 microversion: 2.1 time: 0.157194 May 26 20:27:18.304441 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 194/394] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:18 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:18.833585 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9f0c88dc-c777-4f3b-8b64-c23403a7512f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:18.834211 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9f0c88dc-c777-4f3b-8b64-c23403a7512f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:18.841883 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9f0c88dc-c777-4f3b-8b64-c23403a7512f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:18.842372 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9f0c88dc-c777-4f3b-8b64-c23403a7512f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:18.843143 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9f0c88dc-c777-4f3b-8b64-c23403a7512f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:18.843579 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9f0c88dc-c777-4f3b-8b64-c23403a7512f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:18.951984 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-614fbc18-f6a0-471f-a4d7-57e173e2a077 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:18.953337 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-614fbc18-f6a0-471f-a4d7-57e173e2a077 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:18.960299 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-614fbc18-f6a0-471f-a4d7-57e173e2a077 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:18.961054 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-614fbc18-f6a0-471f-a4d7-57e173e2a077 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:18.962069 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-614fbc18-f6a0-471f-a4d7-57e173e2a077 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:18.962766 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-614fbc18-f6a0-471f-a4d7-57e173e2a077 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:18.978116 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9f0c88dc-c777-4f3b-8b64-c23403a7512f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:18.986208 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9f0c88dc-c777-4f3b-8b64-c23403a7512f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1319 microversion: 2.1 time: 0.156507 May 26 20:27:18.986997 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 201/395] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:18 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:19.102533 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-614fbc18-f6a0-471f-a4d7-57e173e2a077 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:19.110843 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-614fbc18-f6a0-471f-a4d7-57e173e2a077 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.162822 May 26 20:27:19.111413 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 195/396] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:18 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:19.320954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-67a8adef-2c27-4ac6-926a-bb52c22ecdb6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:19.321564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-67a8adef-2c27-4ac6-926a-bb52c22ecdb6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:19.327788 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-67a8adef-2c27-4ac6-926a-bb52c22ecdb6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:19.328238 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-67a8adef-2c27-4ac6-926a-bb52c22ecdb6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:19.329026 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-67a8adef-2c27-4ac6-926a-bb52c22ecdb6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:19.329464 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-67a8adef-2c27-4ac6-926a-bb52c22ecdb6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:19.467178 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-67a8adef-2c27-4ac6-926a-bb52c22ecdb6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:19.474749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-67a8adef-2c27-4ac6-926a-bb52c22ecdb6 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1666 microversion: 2.1 time: 0.157697 May 26 20:27:19.475332 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 202/397] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:19 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:20.003989 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f1560222-28b6-4abb-a55e-f2a438f2338e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:20.004603 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f1560222-28b6-4abb-a55e-f2a438f2338e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:20.011631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f1560222-28b6-4abb-a55e-f2a438f2338e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:20.012079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f1560222-28b6-4abb-a55e-f2a438f2338e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:20.012845 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f1560222-28b6-4abb-a55e-f2a438f2338e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:20.013325 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f1560222-28b6-4abb-a55e-f2a438f2338e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:20.128723 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-d98fcc7b-8192-43d4-8add-87f2448f205e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:20.129381 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-d98fcc7b-8192-43d4-8add-87f2448f205e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:20.136310 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d98fcc7b-8192-43d4-8add-87f2448f205e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:20.136757 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d98fcc7b-8192-43d4-8add-87f2448f205e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:20.137525 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d98fcc7b-8192-43d4-8add-87f2448f205e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:20.137958 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d98fcc7b-8192-43d4-8add-87f2448f205e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:20.154729 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f1560222-28b6-4abb-a55e-f2a438f2338e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:20.199245 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f1560222-28b6-4abb-a55e-f2a438f2338e tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1319 microversion: 2.1 time: 0.162639 May 26 20:27:20.199245 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 196/398] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:19 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:20.279547 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-d98fcc7b-8192-43d4-8add-87f2448f205e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:20.287598 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-d98fcc7b-8192-43d4-8add-87f2448f205e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.162842 May 26 20:27:20.288393 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 203/399] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:20 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:20.480623 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-e6363ebc-d23b-48ed-8f99-c2844aea12b6 req-22290ff8-61ac-4ffd-8c80-73fb0a25883f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b85b88-9a19-473d-a08a-07d3a471dacc", "name": "network-vif-plugged", "status": "completed", "tag": "04e52dc1-16de-4010-be95-99bce2c747aa"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:20.488741 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e6363ebc-d23b-48ed-8f99-c2844aea12b6 req-22290ff8-61ac-4ffd-8c80-73fb0a25883f service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:20.492843 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e6363ebc-d23b-48ed-8f99-c2844aea12b6 req-22290ff8-61ac-4ffd-8c80-73fb0a25883f service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:20.501114 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-e6363ebc-d23b-48ed-8f99-c2844aea12b6 req-22290ff8-61ac-4ffd-8c80-73fb0a25883f service nova] Creating event network-vif-plugged:04e52dc1-16de-4010-be95-99bce2c747aa for instance 48b85b88-9a19-473d-a08a-07d3a471dacc on hv-cinder-84213 May 26 20:27:20.505912 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-e6363ebc-d23b-48ed-8f99-c2844aea12b6 req-22290ff8-61ac-4ffd-8c80-73fb0a25883f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029025 May 26 20:27:20.506730 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 197/400] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:27:21.179586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c8dfa707-c1a8-4f06-a11e-a61d7cb22f94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:21.180312 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c8dfa707-c1a8-4f06-a11e-a61d7cb22f94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:21.182410 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:21.188186 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c8dfa707-c1a8-4f06-a11e-a61d7cb22f94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:21.188697 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c8dfa707-c1a8-4f06-a11e-a61d7cb22f94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:21.189550 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c8dfa707-c1a8-4f06-a11e-a61d7cb22f94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:21.190085 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c8dfa707-c1a8-4f06-a11e-a61d7cb22f94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:21.302069 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:21.303522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:21.309044 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9a622bdd-0eff-4429-982b-38913e135c6b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:21.314634 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9a622bdd-0eff-4429-982b-38913e135c6b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:21.315980 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a622bdd-0eff-4429-982b-38913e135c6b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:21.316426 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a622bdd-0eff-4429-982b-38913e135c6b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:21.317183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a622bdd-0eff-4429-982b-38913e135c6b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:21.317614 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a622bdd-0eff-4429-982b-38913e135c6b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:21.325429 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c8dfa707-c1a8-4f06-a11e-a61d7cb22f94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:21.332868 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c8dfa707-c1a8-4f06-a11e-a61d7cb22f94 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1319 microversion: 2.1 time: 0.157010 May 26 20:27:21.333521 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 204/401] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:21 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:21.453654 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9a622bdd-0eff-4429-982b-38913e135c6b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:21.461635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9a622bdd-0eff-4429-982b-38913e135c6b tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.160487 May 26 20:27:21.462206 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 198/402] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:21 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:22.350649 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9a418473-6ef5-4721-bf71-990ab1365d6f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:22.351262 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9a418473-6ef5-4721-bf71-990ab1365d6f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:22.358426 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9a418473-6ef5-4721-bf71-990ab1365d6f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:22.358933 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9a418473-6ef5-4721-bf71-990ab1365d6f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:22.359696 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9a418473-6ef5-4721-bf71-990ab1365d6f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:22.360173 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9a418473-6ef5-4721-bf71-990ab1365d6f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:22.480024 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-dec7fc1c-dab0-4fee-9aff-14c33e59c56c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:22.480642 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dec7fc1c-dab0-4fee-9aff-14c33e59c56c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:22.487092 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dec7fc1c-dab0-4fee-9aff-14c33e59c56c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:22.487550 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dec7fc1c-dab0-4fee-9aff-14c33e59c56c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:22.488375 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dec7fc1c-dab0-4fee-9aff-14c33e59c56c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:22.488860 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dec7fc1c-dab0-4fee-9aff-14c33e59c56c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:22.492116 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9a418473-6ef5-4721-bf71-990ab1365d6f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:22.500171 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9a418473-6ef5-4721-bf71-990ab1365d6f tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1319 microversion: 2.1 time: 0.153302 May 26 20:27:22.500745 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 205/403] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:22 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:22.617458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-dec7fc1c-dab0-4fee-9aff-14c33e59c56c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:22.625884 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-dec7fc1c-dab0-4fee-9aff-14c33e59c56c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.150363 May 26 20:27:22.632734 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 199/404] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:22 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:23.517358 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-24201fde-1fff-4e71-9236-25dc4571bfd4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:23.517966 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-24201fde-1fff-4e71-9236-25dc4571bfd4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:23.520565 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:23.526408 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24201fde-1fff-4e71-9236-25dc4571bfd4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:23.526800 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24201fde-1fff-4e71-9236-25dc4571bfd4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:23.527623 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24201fde-1fff-4e71-9236-25dc4571bfd4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:23.528090 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24201fde-1fff-4e71-9236-25dc4571bfd4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:23.648814 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7d464358-7ebb-4054-9442-2e45b20098c9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:23.649434 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7d464358-7ebb-4054-9442-2e45b20098c9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:23.656777 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d464358-7ebb-4054-9442-2e45b20098c9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:23.657231 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d464358-7ebb-4054-9442-2e45b20098c9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:23.658011 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d464358-7ebb-4054-9442-2e45b20098c9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:23.658520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d464358-7ebb-4054-9442-2e45b20098c9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:23.663170 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-24201fde-1fff-4e71-9236-25dc4571bfd4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:23.671515 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-24201fde-1fff-4e71-9236-25dc4571bfd4 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1508 microversion: 2.1 time: 0.158358 May 26 20:27:23.672089 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 206/405] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:23 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:23.687899 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-763ec9d4-ae9c-4578-9a39-85633138716a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "018afb4b-217a-4e84-bee5-9fb68a00149b", "device": "/dev/sdb"}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:23.689556 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-763ec9d4-ae9c-4578-9a39-85633138716a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:23.695863 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-763ec9d4-ae9c-4578-9a39-85633138716a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:23.696326 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-763ec9d4-ae9c-4578-9a39-85633138716a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:23.697144 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-763ec9d4-ae9c-4578-9a39-85633138716a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:23.697631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-763ec9d4-ae9c-4578-9a39-85633138716a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:23.803801 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7d464358-7ebb-4054-9442-2e45b20098c9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:23.813249 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7d464358-7ebb-4054-9442-2e45b20098c9 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.168312 May 26 20:27:23.813979 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 200/406] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:23 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:23.918356 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:24.494602 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-763ec9d4-ae9c-4578-9a39-85633138716a tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "POST /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.809713 May 26 20:27:24.495243 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 207/407] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:27:23 2022] POST /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc/os-volume_attachments => generated 194 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:27:24.831244 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fdd02448-ad72-4b7d-8e1b-1d8238210875 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:24.831802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fdd02448-ad72-4b7d-8e1b-1d8238210875 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:24.834102 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:24.839548 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fdd02448-ad72-4b7d-8e1b-1d8238210875 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:24.839992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fdd02448-ad72-4b7d-8e1b-1d8238210875 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:24.841009 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fdd02448-ad72-4b7d-8e1b-1d8238210875 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:24.841694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fdd02448-ad72-4b7d-8e1b-1d8238210875 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:24.980479 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-fdd02448-ad72-4b7d-8e1b-1d8238210875 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:24.988360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fdd02448-ad72-4b7d-8e1b-1d8238210875 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.161092 May 26 20:27:24.992703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 201/408] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:24 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:26.006860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5e3c64b6-6f86-4ffa-a550-9197196fa9f4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:26.007555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5e3c64b6-6f86-4ffa-a550-9197196fa9f4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:26.013807 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5e3c64b6-6f86-4ffa-a550-9197196fa9f4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:26.014271 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5e3c64b6-6f86-4ffa-a550-9197196fa9f4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:26.015052 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5e3c64b6-6f86-4ffa-a550-9197196fa9f4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:26.015487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5e3c64b6-6f86-4ffa-a550-9197196fa9f4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:26.144627 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5e3c64b6-6f86-4ffa-a550-9197196fa9f4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:26.152847 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5e3c64b6-6f86-4ffa-a550-9197196fa9f4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.150714 May 26 20:27:26.153415 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 208/409] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:26 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:27.170634 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-aebfc284-7764-4472-8410-f5531598ce65 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:27.171149 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-aebfc284-7764-4472-8410-f5531598ce65 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:27.177851 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aebfc284-7764-4472-8410-f5531598ce65 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:27.178323 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aebfc284-7764-4472-8410-f5531598ce65 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:27.179078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aebfc284-7764-4472-8410-f5531598ce65 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:27.179513 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aebfc284-7764-4472-8410-f5531598ce65 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:27.308157 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-aebfc284-7764-4472-8410-f5531598ce65 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:27.315998 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-aebfc284-7764-4472-8410-f5531598ce65 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.149959 May 26 20:27:27.316551 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 202/410] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:27 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:28.120756 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-bcba17b6-488c-448d-a552-251e9d9250fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:28.121384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-bcba17b6-488c-448d-a552-251e9d9250fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:28.127899 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bcba17b6-488c-448d-a552-251e9d9250fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:28.128343 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bcba17b6-488c-448d-a552-251e9d9250fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:28.129100 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bcba17b6-488c-448d-a552-251e9d9250fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:28.129530 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bcba17b6-488c-448d-a552-251e9d9250fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:28.152452 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-bcba17b6-488c-448d-a552-251e9d9250fd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b/ips" status: 200 len: 148 microversion: 2.1 time: 0.036054 May 26 20:27:28.153009 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 209/411] 10.222.0.44 () {58 vars in 1247 bytes} [Thu May 26 20:27:28 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:27:28.163279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-20e550ed-3edd-4589-9837-22c6c629ff98 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3243204d-dd73-4112-8756-d6af135952c9"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:28.164336 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-20e550ed-3edd-4589-9837-22c6c629ff98 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:28.170593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e550ed-3edd-4589-9837-22c6c629ff98 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:28.171039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e550ed-3edd-4589-9837-22c6c629ff98 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:28.171869 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e550ed-3edd-4589-9837-22c6c629ff98 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:28.172305 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20e550ed-3edd-4589-9837-22c6c629ff98 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:28.258562 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-20e550ed-3edd-4589-9837-22c6c629ff98 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Invalid volume: volume 3243204d-dd73-4112-8756-d6af135952c9 is already attached to instances: 91a2054d-de32-402c-8f6a-2f753925164d May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-20e550ed-3edd-4589-9837-22c6c629ff98 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: POST /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b/os-volume_attachments HTTP/1.1 May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 74 May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:27:28.260275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:27:28.262720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:27:28.262720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:27:28.262720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:27:28.262720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:27:28.262720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:27:28.262720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:27:28.262720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:27:28.262720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:27:28.262720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:27:28.262720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: May 26 20:27:28.262720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {"volumeAttachment": {"volumeId": "3243204d-dd73-4112-8756-d6af135952c9"}} May 26 20:27:28.262720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Invalid volume: volume 3243204d-dd73-4112-8756-d6af135952c9 is already attached to instances: 91a2054d-de32-402c-8f6a-2f753925164d May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'server_id': '0e33194d-abb0-4789-9dd9-7a0cf235852b', 'body': {'volumeAttachment': {'volumeId': '3243204d-dd73-4112-8756-d6af135952c9'}}} May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3243204d-dd73-4112-8756-d6af135952c9 is already attached to instances: 91a2054d-de32-402c-8f6a-2f753925164d May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:28.263677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3243204d-dd73-4112-8756-d6af135952c9 is already attached to instances: 91a2054d-de32-402c-8f6a-2f753925164d May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:28.265349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:27:28.267060 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:27:28.267060 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:27:28.267060 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:27:28.267060 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3243204d-dd73-4112-8756-d6af135952c9 is already attached to instances: 91a2054d-de32-402c-8f6a-2f753925164d May 26 20:27:28.267060 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:28.267060 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-20e550ed-3edd-4589-9837-22c6c629ff98 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 400 to user: Invalid volume: volume 3243204d-dd73-4112-8756-d6af135952c9 is already attached to instances: 91a2054d-de32-402c-8f6a-2f753925164d {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:27:28.267060 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-20e550ed-3edd-4589-9837-22c6c629ff98 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102725 May 26 20:27:28.267060 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 203/412] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:27:28 2022] POST /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 20:27:28.273373 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-fc40013a-e017-4b96-a686-fbb294eccb54 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:28.273902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-fc40013a-e017-4b96-a686-fbb294eccb54 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:28.281350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fc40013a-e017-4b96-a686-fbb294eccb54 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:28.281796 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fc40013a-e017-4b96-a686-fbb294eccb54 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:28.282586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fc40013a-e017-4b96-a686-fbb294eccb54 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:28.283020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fc40013a-e017-4b96-a686-fbb294eccb54 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:28.308986 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-fc40013a-e017-4b96-a686-fbb294eccb54 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Going to try to terminate instance {{(pid=118306) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:27:28.333584 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eba72450-77f2-4bcc-b61c-509e507d69e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:28.334255 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eba72450-77f2-4bcc-b61c-509e507d69e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:28.340599 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eba72450-77f2-4bcc-b61c-509e507d69e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:28.341050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eba72450-77f2-4bcc-b61c-509e507d69e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:28.342073 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eba72450-77f2-4bcc-b61c-509e507d69e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:28.342542 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eba72450-77f2-4bcc-b61c-509e507d69e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:28.476759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-eba72450-77f2-4bcc-b61c-509e507d69e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:28.480949 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:28.486179 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eba72450-77f2-4bcc-b61c-509e507d69e6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.156293 May 26 20:27:28.498273 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 204/413] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:28 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:28.565736 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-fc40013a-e017-4b96-a686-fbb294eccb54 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 204 len: 0 microversion: 2.1 time: 0.296711 May 26 20:27:28.566366 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 210/414] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:27:28 2022] DELETE /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:27:28.574877 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2a82e974-f982-43c3-8c7c-c5c67fb1545b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:28.575499 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2a82e974-f982-43c3-8c7c-c5c67fb1545b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:28.582186 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2a82e974-f982-43c3-8c7c-c5c67fb1545b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:28.582677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2a82e974-f982-43c3-8c7c-c5c67fb1545b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:28.583446 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2a82e974-f982-43c3-8c7c-c5c67fb1545b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:28.583885 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2a82e974-f982-43c3-8c7c-c5c67fb1545b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:28.711965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2a82e974-f982-43c3-8c7c-c5c67fb1545b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:28.720306 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2a82e974-f982-43c3-8c7c-c5c67fb1545b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1680 microversion: 2.1 time: 0.149728 May 26 20:27:28.720865 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 205/415] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:28 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:29.505104 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-41cd8ce0-b019-4363-8a66-0a29cb6d363d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:29.505802 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-41cd8ce0-b019-4363-8a66-0a29cb6d363d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:29.520736 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-41cd8ce0-b019-4363-8a66-0a29cb6d363d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:29.521290 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-41cd8ce0-b019-4363-8a66-0a29cb6d363d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:29.522160 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-41cd8ce0-b019-4363-8a66-0a29cb6d363d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:29.522661 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-41cd8ce0-b019-4363-8a66-0a29cb6d363d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:29.662094 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-41cd8ce0-b019-4363-8a66-0a29cb6d363d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:29.670282 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-41cd8ce0-b019-4363-8a66-0a29cb6d363d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.169456 May 26 20:27:29.670850 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 211/416] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:29 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:29.738458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7b9c84d5-db00-45e4-b657-c31e8775094c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:29.739064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7b9c84d5-db00-45e4-b657-c31e8775094c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:29.746043 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b9c84d5-db00-45e4-b657-c31e8775094c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:29.746507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b9c84d5-db00-45e4-b657-c31e8775094c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:29.747262 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b9c84d5-db00-45e4-b657-c31e8775094c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:29.747689 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7b9c84d5-db00-45e4-b657-c31e8775094c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:29.882610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7b9c84d5-db00-45e4-b657-c31e8775094c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:29.891304 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7b9c84d5-db00-45e4-b657-c31e8775094c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1680 microversion: 2.1 time: 0.156675 May 26 20:27:29.891859 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 206/417] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:29 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:30.698018 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-99803631-2526-4160-a52b-76e7b9af7699 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:30.698787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-99803631-2526-4160-a52b-76e7b9af7699 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:30.706131 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-99803631-2526-4160-a52b-76e7b9af7699 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:30.706802 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-99803631-2526-4160-a52b-76e7b9af7699 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:30.707800 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-99803631-2526-4160-a52b-76e7b9af7699 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:30.708299 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-99803631-2526-4160-a52b-76e7b9af7699 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:30.855875 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-99803631-2526-4160-a52b-76e7b9af7699 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:30.864378 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-99803631-2526-4160-a52b-76e7b9af7699 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.180273 May 26 20:27:30.865167 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 212/418] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:30 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:30.912446 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4b5a70c8-d2eb-448d-90fb-b167205ec64b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:30.913610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4b5a70c8-d2eb-448d-90fb-b167205ec64b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:30.922195 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b5a70c8-d2eb-448d-90fb-b167205ec64b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:30.922680 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b5a70c8-d2eb-448d-90fb-b167205ec64b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:30.923461 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b5a70c8-d2eb-448d-90fb-b167205ec64b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:30.923899 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b5a70c8-d2eb-448d-90fb-b167205ec64b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:31.130221 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-4b5a70c8-d2eb-448d-90fb-b167205ec64b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:31.138108 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4b5a70c8-d2eb-448d-90fb-b167205ec64b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1680 microversion: 2.1 time: 0.230476 May 26 20:27:31.141488 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 207/419] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:30 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:31.356186 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-1f54124e-5c93-4bb2-8ace-3f5bc547998c req-7ddeb8c9-90c8-4668-99e6-b55c15124189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e33194d-abb0-4789-9dd9-7a0cf235852b", "name": "network-vif-deleted", "tag": "360375bb-85b1-44dd-8e4f-7c8f582388b6"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:31.364240 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-1f54124e-5c93-4bb2-8ace-3f5bc547998c req-7ddeb8c9-90c8-4668-99e6-b55c15124189 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:31.364898 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-1f54124e-5c93-4bb2-8ace-3f5bc547998c req-7ddeb8c9-90c8-4668-99e6-b55c15124189 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:31.376698 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-1f54124e-5c93-4bb2-8ace-3f5bc547998c req-7ddeb8c9-90c8-4668-99e6-b55c15124189 service nova] Creating event network-vif-deleted:360375bb-85b1-44dd-8e4f-7c8f582388b6 for instance 0e33194d-abb0-4789-9dd9-7a0cf235852b on hv-cinder-84213 May 26 20:27:31.382173 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-1f54124e-5c93-4bb2-8ace-3f5bc547998c req-7ddeb8c9-90c8-4668-99e6-b55c15124189 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029768 May 26 20:27:31.382908 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 213/420] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:27:31.884660 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-722337a0-34ed-46e1-a8d5-005abc2face1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:31.887337 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-722337a0-34ed-46e1-a8d5-005abc2face1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:31.896409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-722337a0-34ed-46e1-a8d5-005abc2face1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:31.903151 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-722337a0-34ed-46e1-a8d5-005abc2face1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:31.903151 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-722337a0-34ed-46e1-a8d5-005abc2face1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:31.904315 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-722337a0-34ed-46e1-a8d5-005abc2face1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:32.110443 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-722337a0-34ed-46e1-a8d5-005abc2face1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:32.119210 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-722337a0-34ed-46e1-a8d5-005abc2face1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.239348 May 26 20:27:32.119771 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 208/421] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:31 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:32.157007 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8ca83310-534c-480c-bb6c-1fd224819a4e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:32.157931 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8ca83310-534c-480c-bb6c-1fd224819a4e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:32.165008 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ca83310-534c-480c-bb6c-1fd224819a4e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:32.165474 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ca83310-534c-480c-bb6c-1fd224819a4e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:32.166270 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ca83310-534c-480c-bb6c-1fd224819a4e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:32.166765 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ca83310-534c-480c-bb6c-1fd224819a4e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:32.200999 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ca83310-534c-480c-bb6c-1fd224819a4e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:32.201444 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8ca83310-534c-480c-bb6c-1fd224819a4e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:32.201899 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-8ca83310-534c-480c-bb6c-1fd224819a4e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lazy-loading 'fault' on Instance uuid 0e33194d-abb0-4789-9dd9-7a0cf235852b {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:27:32.259222 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8ca83310-534c-480c-bb6c-1fd224819a4e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:32.267643 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8ca83310-534c-480c-bb6c-1fd224819a4e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1332 microversion: 2.1 time: 0.116154 May 26 20:27:32.268207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 214/422] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:32 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:33.138542 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7afed2b9-7aac-4da3-8c5c-747aa7ac95ea tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:33.139190 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7afed2b9-7aac-4da3-8c5c-747aa7ac95ea tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:33.145447 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7afed2b9-7aac-4da3-8c5c-747aa7ac95ea tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:33.145833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7afed2b9-7aac-4da3-8c5c-747aa7ac95ea tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:33.146628 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7afed2b9-7aac-4da3-8c5c-747aa7ac95ea tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:33.147296 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7afed2b9-7aac-4da3-8c5c-747aa7ac95ea tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:33.277586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7afed2b9-7aac-4da3-8c5c-747aa7ac95ea tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:33.284910 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-d444968c-d03f-462f-b5af-61debebaf334 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:33.288922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-d444968c-d03f-462f-b5af-61debebaf334 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:33.289045 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7afed2b9-7aac-4da3-8c5c-747aa7ac95ea tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.153153 May 26 20:27:33.289045 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 209/423] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:33 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:33.293458 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d444968c-d03f-462f-b5af-61debebaf334 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:33.293960 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d444968c-d03f-462f-b5af-61debebaf334 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:33.294844 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d444968c-d03f-462f-b5af-61debebaf334 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:33.295331 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d444968c-d03f-462f-b5af-61debebaf334 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:33.328184 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d444968c-d03f-462f-b5af-61debebaf334 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:33.328733 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d444968c-d03f-462f-b5af-61debebaf334 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:33.329263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-d444968c-d03f-462f-b5af-61debebaf334 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lazy-loading 'fault' on Instance uuid 0e33194d-abb0-4789-9dd9-7a0cf235852b {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:27:33.369879 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-d444968c-d03f-462f-b5af-61debebaf334 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:33.378067 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-d444968c-d03f-462f-b5af-61debebaf334 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 200 len: 1332 microversion: 2.1 time: 0.096970 May 26 20:27:33.378686 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 215/424] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:33 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:34.304843 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ddef98bb-124b-44fb-9533-ca80a68a8825 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:34.305449 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ddef98bb-124b-44fb-9533-ca80a68a8825 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:34.312096 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ddef98bb-124b-44fb-9533-ca80a68a8825 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:34.312539 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ddef98bb-124b-44fb-9533-ca80a68a8825 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:34.313299 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ddef98bb-124b-44fb-9533-ca80a68a8825 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:34.313743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ddef98bb-124b-44fb-9533-ca80a68a8825 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:34.396114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-74f77dbd-58a1-4a3d-9f65-5f55ce074066 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:34.397399 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-74f77dbd-58a1-4a3d-9f65-5f55ce074066 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:34.405809 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-74f77dbd-58a1-4a3d-9f65-5f55ce074066 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:34.406269 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-74f77dbd-58a1-4a3d-9f65-5f55ce074066 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:34.407110 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-74f77dbd-58a1-4a3d-9f65-5f55ce074066 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:34.407537 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-74f77dbd-58a1-4a3d-9f65-5f55ce074066 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:34.444070 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-74f77dbd-58a1-4a3d-9f65-5f55ce074066 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-74f77dbd-58a1-4a3d-9f65-5f55ce074066 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b HTTP/1.1 May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:27:34.446394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:27:34.449839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:27:34.449839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:27:34.449839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:27:34.449839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:27:34.449839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:27:34.449839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:27:34.449839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:27:34.449839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:27:34.449839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:27:34.449839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:27:34.449839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:27:34.449839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '0e33194d-abb0-4789-9dd9-7a0cf235852b'} May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:27:34.450687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:27:34.452080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:27:34.453438 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-74f77dbd-58a1-4a3d-9f65-5f55ce074066 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 404 to user: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:27:34.453438 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-74f77dbd-58a1-4a3d-9f65-5f55ce074066 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 404 len: 111 microversion: 2.1 time: 0.055584 May 26 20:27:34.453438 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 216/425] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:34 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 20:27:34.457520 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-aa7b02ba-b087-45a3-9a5e-2d74a04547ee tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '.version_select at 0x7f2da453c550>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:34.475021 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ddef98bb-124b-44fb-9533-ca80a68a8825 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:34.484446 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ddef98bb-124b-44fb-9533-ca80a68a8825 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1734 microversion: 2.1 time: 0.183435 May 26 20:27:34.485123 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 210/426] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:34 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:34.559815 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-aa7b02ba-b087-45a3-9a5e-2d74a04547ee tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877103220" status: 202 len: 0 microversion: 2.1 time: 0.105830 May 26 20:27:34.560613 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 217/427] 10.222.0.44 () {58 vars in 1220 bytes} [Thu May 26 20:27:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877103220 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 20:27:35.400715 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-53314e13-c4a6-4b20-991a-512770018d5a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:35.401747 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-53314e13-c4a6-4b20-991a-512770018d5a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:35.408562 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-53314e13-c4a6-4b20-991a-512770018d5a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:35.409012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-53314e13-c4a6-4b20-991a-512770018d5a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:35.409783 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-53314e13-c4a6-4b20-991a-512770018d5a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:35.410260 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-53314e13-c4a6-4b20-991a-512770018d5a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:35.491463 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-53314e13-c4a6-4b20-991a-512770018d5a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lazy-loading 'services' on Instance uuid 91a2054d-de32-402c-8f6a-2f753925164d {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:27:35.501683 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-d2967eb2-707f-4295-a269-6de4735ea198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:35.502317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-d2967eb2-707f-4295-a269-6de4735ea198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:35.510594 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d2967eb2-707f-4295-a269-6de4735ea198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:35.511229 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d2967eb2-707f-4295-a269-6de4735ea198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:35.511994 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d2967eb2-707f-4295-a269-6de4735ea198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:35.512423 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d2967eb2-707f-4295-a269-6de4735ea198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:35.652580 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-d2967eb2-707f-4295-a269-6de4735ea198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:35.660672 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-d2967eb2-707f-4295-a269-6de4735ea198 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1714 microversion: 2.1 time: 0.163403 May 26 20:27:35.661258 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 218/428] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:35 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1714 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:35.712148 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-53314e13-c4a6-4b20-991a-512770018d5a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments/3243204d-dd73-4112-8756-d6af135952c9" status: 202 len: 0 microversion: 2.1 time: 0.315294 May 26 20:27:35.712819 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 211/429] 10.222.0.44 () {58 vars in 1415 bytes} [Thu May 26 20:27:35 2022] DELETE /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments/3243204d-dd73-4112-8756-d6af135952c9 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:27:35.722104 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-dfe5a366-1a1e-4961-9b19-59ff9edf915e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:35.725260 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-dfe5a366-1a1e-4961-9b19-59ff9edf915e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:35.729107 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dfe5a366-1a1e-4961-9b19-59ff9edf915e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:35.730482 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dfe5a366-1a1e-4961-9b19-59ff9edf915e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:35.731305 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dfe5a366-1a1e-4961-9b19-59ff9edf915e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:35.731743 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dfe5a366-1a1e-4961-9b19-59ff9edf915e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:35.764021 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-dfe5a366-1a1e-4961-9b19-59ff9edf915e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045804 May 26 20:27:35.764581 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 219/430] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:27:35 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:27:35.765111 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9b9be3b0-fa58-451f-a451-68e224212455 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:35.765776 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9b9be3b0-fa58-451f-a451-68e224212455 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:35.772341 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9b9be3b0-fa58-451f-a451-68e224212455 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:35.772787 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9b9be3b0-fa58-451f-a451-68e224212455 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:35.773546 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9b9be3b0-fa58-451f-a451-68e224212455 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:35.773977 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9b9be3b0-fa58-451f-a451-68e224212455 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:35.854693 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-9b9be3b0-fa58-451f-a451-68e224212455 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] HTTP exception thrown: Cannot 'detach_volume' instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 while it is in vm_state rescued May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9b9be3b0-fa58-451f-a451-68e224212455 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Request method failure captured: May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: DELETE /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments/bbb26693-7525-40c6-9fab-b92ad7ba86b8 HTTP/1.1 May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HMctYnQef_fAFPqfLUdEsnXRp3PwFjMEZRaQa7XPlJWn0X3l7DHadWcb2y0MoBJ1Hg8jC9EJQtLjfc-f0GM-q2csWz-teo7cHIAXDxZzA1vXKbu_xP23ZMRI-6Dd4cd3BeN3sMIbgVw_F3vNl2TJ_XqOLmKvEG7iH0NVNfQM8lyCE May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: f6160118ba95403e8df08ac74982954d May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:27:35.856545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:27:35.858052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f6160118ba95403e8df08ac74982954d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6160118ba95403e8df08ac74982954d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f6160118ba95403e8df08ac74982954d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6160118ba95403e8df08ac74982954d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:27:35.858052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:27:35.858052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: f6160118ba95403e8df08ac74982954d May 26 20:27:35.858052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:27:35.858052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-ServerRescueNegativeTestJSON-1606344399-project May 26 20:27:35.858052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:27:35.858052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:27:35.858052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 146a7d1f40854f859864d463f403178f May 26 20:27:35.858052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606344399-project May 26 20:27:35.858052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:27:35.858052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Cannot 'detach_volume' instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 while it is in vm_state rescued May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'server_id': '6602854b-bca1-47cb-9307-9e01ce9e96d7', 'id': 'bbb26693-7525-40c6-9fab-b92ad7ba86b8'} May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:27:35.858854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 while it is in vm_state rescued May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 while it is in vm_state rescued May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:35.860094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9b9be3b0-fa58-451f-a451-68e224212455 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Returning 409 to user: Cannot 'detach_volume' instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 while it is in vm_state rescued {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:27:35.861224 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9b9be3b0-fa58-451f-a451-68e224212455 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments/bbb26693-7525-40c6-9fab-b92ad7ba86b8" status: 409 len: 152 microversion: 2.1 time: 0.098104 May 26 20:27:35.861224 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 212/431] 10.222.0.44 () {58 vars in 1415 bytes} [Thu May 26 20:27:35 2022] DELETE /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments/bbb26693-7525-40c6-9fab-b92ad7ba86b8 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 26 20:27:35.866760 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8be15e7e-da32-4f06-8b29-60f17fce3ebc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:35.867299 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8be15e7e-da32-4f06-8b29-60f17fce3ebc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:35.873449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8be15e7e-da32-4f06-8b29-60f17fce3ebc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:35.873896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8be15e7e-da32-4f06-8b29-60f17fce3ebc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:35.874724 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8be15e7e-da32-4f06-8b29-60f17fce3ebc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:35.875218 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8be15e7e-da32-4f06-8b29-60f17fce3ebc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:36.094854 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8be15e7e-da32-4f06-8b29-60f17fce3ebc tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "POST /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/action" status: 202 len: 0 microversion: 2.1 time: 0.231592 May 26 20:27:36.095874 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 220/432] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:27:35 2022] POST /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:27:36.103471 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-98ceeb6b-c564-4f36-9574-b3abc0521050 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:36.104080 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-98ceeb6b-c564-4f36-9574-b3abc0521050 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:36.111648 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98ceeb6b-c564-4f36-9574-b3abc0521050 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:36.112144 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98ceeb6b-c564-4f36-9574-b3abc0521050 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:36.112909 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98ceeb6b-c564-4f36-9574-b3abc0521050 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:36.113351 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98ceeb6b-c564-4f36-9574-b3abc0521050 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:36.245553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-98ceeb6b-c564-4f36-9574-b3abc0521050 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:36.253475 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-98ceeb6b-c564-4f36-9574-b3abc0521050 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1722 microversion: 2.1 time: 0.153932 May 26 20:27:36.256461 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 213/433] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:36 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:36.777737 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2d367ac3-1ce7-4a19-921c-24986848c032 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:36.778780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2d367ac3-1ce7-4a19-921c-24986848c032 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:36.785116 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2d367ac3-1ce7-4a19-921c-24986848c032 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:36.785610 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2d367ac3-1ce7-4a19-921c-24986848c032 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:36.786407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2d367ac3-1ce7-4a19-921c-24986848c032 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:36.786841 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2d367ac3-1ce7-4a19-921c-24986848c032 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:36.816001 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2d367ac3-1ce7-4a19-921c-24986848c032 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 May 26 20:27:36.816479 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 221/434] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:27:36 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:27:37.271028 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1f5caf8d-2ceb-42e5-b8b5-82b74bc08a8d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:37.271639 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1f5caf8d-2ceb-42e5-b8b5-82b74bc08a8d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:37.278286 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f5caf8d-2ceb-42e5-b8b5-82b74bc08a8d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:37.278736 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f5caf8d-2ceb-42e5-b8b5-82b74bc08a8d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:37.279505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f5caf8d-2ceb-42e5-b8b5-82b74bc08a8d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:37.279940 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1f5caf8d-2ceb-42e5-b8b5-82b74bc08a8d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:37.408538 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-1f5caf8d-2ceb-42e5-b8b5-82b74bc08a8d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:37.416356 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1f5caf8d-2ceb-42e5-b8b5-82b74bc08a8d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1722 microversion: 2.1 time: 0.149264 May 26 20:27:37.417680 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 214/435] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:37 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:37.828156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-879924a8-28bd-47f2-8def-b2bc1b565034 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:37.829110 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-879924a8-28bd-47f2-8def-b2bc1b565034 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:37.835758 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-879924a8-28bd-47f2-8def-b2bc1b565034 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:37.836206 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-879924a8-28bd-47f2-8def-b2bc1b565034 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:37.837060 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-879924a8-28bd-47f2-8def-b2bc1b565034 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:37.837627 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-879924a8-28bd-47f2-8def-b2bc1b565034 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:37.866827 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:37.872721 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-879924a8-28bd-47f2-8def-b2bc1b565034 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048543 May 26 20:27:37.873295 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 222/436] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:27:37 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:27:38.434466 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c592c5f9-a9fd-4c44-8d8a-d06b4f4da73e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:38.438761 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c592c5f9-a9fd-4c44-8d8a-d06b4f4da73e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:38.441870 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c592c5f9-a9fd-4c44-8d8a-d06b4f4da73e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:38.442360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c592c5f9-a9fd-4c44-8d8a-d06b4f4da73e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:38.443144 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c592c5f9-a9fd-4c44-8d8a-d06b4f4da73e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:38.443584 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c592c5f9-a9fd-4c44-8d8a-d06b4f4da73e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:38.739767 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c592c5f9-a9fd-4c44-8d8a-d06b4f4da73e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:38.748729 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c592c5f9-a9fd-4c44-8d8a-d06b4f4da73e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1722 microversion: 2.1 time: 0.318667 May 26 20:27:38.750098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 215/437] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:38 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:38.884466 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0570148d-aa2c-4e56-a597-1e6ab6bbe363 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:38.885421 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0570148d-aa2c-4e56-a597-1e6ab6bbe363 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:38.892732 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0570148d-aa2c-4e56-a597-1e6ab6bbe363 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:38.893174 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0570148d-aa2c-4e56-a597-1e6ab6bbe363 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:38.893987 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0570148d-aa2c-4e56-a597-1e6ab6bbe363 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:38.894802 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0570148d-aa2c-4e56-a597-1e6ab6bbe363 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:38.928817 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0570148d-aa2c-4e56-a597-1e6ab6bbe363 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048323 May 26 20:27:38.929534 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 223/438] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:27:38 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:27:39.765629 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e0603ad1-d471-4a91-8377-f6c8655d320c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:39.766150 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e0603ad1-d471-4a91-8377-f6c8655d320c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:39.772532 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0603ad1-d471-4a91-8377-f6c8655d320c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:39.776455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0603ad1-d471-4a91-8377-f6c8655d320c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:39.776455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0603ad1-d471-4a91-8377-f6c8655d320c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:39.776455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0603ad1-d471-4a91-8377-f6c8655d320c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:39.926372 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e0603ad1-d471-4a91-8377-f6c8655d320c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:39.935087 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e0603ad1-d471-4a91-8377-f6c8655d320c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1722 microversion: 2.1 time: 0.173330 May 26 20:27:39.936232 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 216/439] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:39 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:39.940484 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-3e230d80-0000-42eb-b4ee-e470b4758d91 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:39.941402 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3e230d80-0000-42eb-b4ee-e470b4758d91 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:39.948841 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3e230d80-0000-42eb-b4ee-e470b4758d91 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:39.949290 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3e230d80-0000-42eb-b4ee-e470b4758d91 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:39.950035 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3e230d80-0000-42eb-b4ee-e470b4758d91 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:39.950489 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3e230d80-0000-42eb-b4ee-e470b4758d91 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:39.982829 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-3e230d80-0000-42eb-b4ee-e470b4758d91 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046244 May 26 20:27:39.983329 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 224/440] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:27:39 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 20:27:40.060844 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fff78eb4-da9e-4525-89e8-bdb334d513b5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:40.061343 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fff78eb4-da9e-4525-89e8-bdb334d513b5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:40.067393 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fff78eb4-da9e-4525-89e8-bdb334d513b5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:40.067842 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fff78eb4-da9e-4525-89e8-bdb334d513b5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:40.068604 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fff78eb4-da9e-4525-89e8-bdb334d513b5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:40.069039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fff78eb4-da9e-4525-89e8-bdb334d513b5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:40.094458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fff78eb4-da9e-4525-89e8-bdb334d513b5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:27:40.392558 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fff78eb4-da9e-4525-89e8-bdb334d513b5 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 204 len: 0 microversion: 2.1 time: 0.335865 May 26 20:27:40.393148 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 217/441] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:27:40 2022] DELETE /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:27:40.402187 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5bb9c0c0-9789-4ee2-8769-6a495dd172d0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:40.402869 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5bb9c0c0-9789-4ee2-8769-6a495dd172d0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:40.412490 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5bb9c0c0-9789-4ee2-8769-6a495dd172d0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:40.412971 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5bb9c0c0-9789-4ee2-8769-6a495dd172d0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:40.413804 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5bb9c0c0-9789-4ee2-8769-6a495dd172d0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:40.414261 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5bb9c0c0-9789-4ee2-8769-6a495dd172d0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:40.548775 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5bb9c0c0-9789-4ee2-8769-6a495dd172d0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:40.556541 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5bb9c0c0-9789-4ee2-8769-6a495dd172d0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1680 microversion: 2.1 time: 0.159128 May 26 20:27:40.557171 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 225/442] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:40 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:40.952659 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1b47d936-8904-4d11-b164-e4e45925cce5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:40.953388 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1b47d936-8904-4d11-b164-e4e45925cce5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:40.959788 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1b47d936-8904-4d11-b164-e4e45925cce5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:40.960243 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1b47d936-8904-4d11-b164-e4e45925cce5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:40.961003 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1b47d936-8904-4d11-b164-e4e45925cce5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:40.961435 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1b47d936-8904-4d11-b164-e4e45925cce5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:41.130050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-1b47d936-8904-4d11-b164-e4e45925cce5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:41.138867 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1b47d936-8904-4d11-b164-e4e45925cce5 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1722 microversion: 2.1 time: 0.190536 May 26 20:27:41.141601 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 218/443] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:40 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:41.577246 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-af930e25-e0ae-4bc4-a10d-d2e3d7bc005c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:41.577854 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-af930e25-e0ae-4bc4-a10d-d2e3d7bc005c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:41.584431 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-af930e25-e0ae-4bc4-a10d-d2e3d7bc005c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:41.584878 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-af930e25-e0ae-4bc4-a10d-d2e3d7bc005c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:41.585634 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-af930e25-e0ae-4bc4-a10d-d2e3d7bc005c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:41.586073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-af930e25-e0ae-4bc4-a10d-d2e3d7bc005c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:41.720628 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-af930e25-e0ae-4bc4-a10d-d2e3d7bc005c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:41.728278 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-af930e25-e0ae-4bc4-a10d-d2e3d7bc005c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1680 microversion: 2.1 time: 0.155828 May 26 20:27:41.728849 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 226/444] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:41 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:42.156616 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eb83bb75-c39a-466a-9f31-66cf3deb5edd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:42.157747 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eb83bb75-c39a-466a-9f31-66cf3deb5edd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:42.163900 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb83bb75-c39a-466a-9f31-66cf3deb5edd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:42.164362 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb83bb75-c39a-466a-9f31-66cf3deb5edd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:42.165243 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb83bb75-c39a-466a-9f31-66cf3deb5edd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:42.165892 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb83bb75-c39a-466a-9f31-66cf3deb5edd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:42.171059 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:42.310613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-eb83bb75-c39a-466a-9f31-66cf3deb5edd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:42.319552 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eb83bb75-c39a-466a-9f31-66cf3deb5edd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1722 microversion: 2.1 time: 0.167431 May 26 20:27:42.320118 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 219/445] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:42 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:42.746432 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cb45f721-2a74-4130-b857-ef4fc546fcfd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:42.747788 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-cb45f721-2a74-4130-b857-ef4fc546fcfd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:42.756111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cb45f721-2a74-4130-b857-ef4fc546fcfd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:42.756633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cb45f721-2a74-4130-b857-ef4fc546fcfd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:42.757694 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cb45f721-2a74-4130-b857-ef4fc546fcfd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:42.758214 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cb45f721-2a74-4130-b857-ef4fc546fcfd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:43.004844 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cb45f721-2a74-4130-b857-ef4fc546fcfd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:43.012569 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-cb45f721-2a74-4130-b857-ef4fc546fcfd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1680 microversion: 2.1 time: 0.270224 May 26 20:27:43.013509 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 227/446] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:42 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1680 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:43.338940 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e79f115f-0768-40ee-be58-518c1685e03a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:43.339711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e79f115f-0768-40ee-be58-518c1685e03a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:43.349587 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e79f115f-0768-40ee-be58-518c1685e03a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:43.350041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e79f115f-0768-40ee-be58-518c1685e03a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:43.353983 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e79f115f-0768-40ee-be58-518c1685e03a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:43.353983 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e79f115f-0768-40ee-be58-518c1685e03a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:43.509610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e79f115f-0768-40ee-be58-518c1685e03a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:43.518658 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e79f115f-0768-40ee-be58-518c1685e03a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1722 microversion: 2.1 time: 0.184611 May 26 20:27:43.519699 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 220/447] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:43 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:44.031198 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e81d0ed6-398d-4d30-8007-db7989d43bdf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:44.032705 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e81d0ed6-398d-4d30-8007-db7989d43bdf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:44.043039 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e81d0ed6-398d-4d30-8007-db7989d43bdf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:44.043764 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e81d0ed6-398d-4d30-8007-db7989d43bdf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:44.044919 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e81d0ed6-398d-4d30-8007-db7989d43bdf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:44.045502 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e81d0ed6-398d-4d30-8007-db7989d43bdf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:44.311301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e81d0ed6-398d-4d30-8007-db7989d43bdf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:44.320651 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e81d0ed6-398d-4d30-8007-db7989d43bdf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1680 microversion: 2.1 time: 0.294949 May 26 20:27:44.321708 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 228/448] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:44 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1680 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:44.536371 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c31ba246-5d5a-41b0-8d56-f68aeb66dbdd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:44.538713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c31ba246-5d5a-41b0-8d56-f68aeb66dbdd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:44.552083 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c31ba246-5d5a-41b0-8d56-f68aeb66dbdd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:44.552549 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c31ba246-5d5a-41b0-8d56-f68aeb66dbdd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:44.553345 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c31ba246-5d5a-41b0-8d56-f68aeb66dbdd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:44.553786 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c31ba246-5d5a-41b0-8d56-f68aeb66dbdd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:44.711564 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c31ba246-5d5a-41b0-8d56-f68aeb66dbdd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:44.721898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c31ba246-5d5a-41b0-8d56-f68aeb66dbdd tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1722 microversion: 2.1 time: 0.189573 May 26 20:27:44.722582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 221/449] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:44 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:45.339703 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7b6d7d31-7c2a-4b05-a764-e086e55bf90e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:45.341604 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7b6d7d31-7c2a-4b05-a764-e086e55bf90e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:45.347723 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7b6d7d31-7c2a-4b05-a764-e086e55bf90e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:45.348170 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7b6d7d31-7c2a-4b05-a764-e086e55bf90e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:45.348934 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7b6d7d31-7c2a-4b05-a764-e086e55bf90e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:45.349365 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7b6d7d31-7c2a-4b05-a764-e086e55bf90e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:45.611758 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7b6d7d31-7c2a-4b05-a764-e086e55bf90e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:45.624219 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7b6d7d31-7c2a-4b05-a764-e086e55bf90e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1680 microversion: 2.1 time: 0.288779 May 26 20:27:45.624952 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 229/450] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:45 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1680 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:45.740308 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-92fdedde-e23b-45d1-b477-ec9a0ba148c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:45.741248 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-92fdedde-e23b-45d1-b477-ec9a0ba148c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:45.753631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-92fdedde-e23b-45d1-b477-ec9a0ba148c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:45.754166 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-92fdedde-e23b-45d1-b477-ec9a0ba148c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:45.755118 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-92fdedde-e23b-45d1-b477-ec9a0ba148c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:45.755691 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-92fdedde-e23b-45d1-b477-ec9a0ba148c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:46.003211 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-92fdedde-e23b-45d1-b477-ec9a0ba148c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:46.011547 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-92fdedde-e23b-45d1-b477-ec9a0ba148c7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1728 microversion: 2.1 time: 0.275220 May 26 20:27:46.016941 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 222/451] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:45 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1728 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:46.037880 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6aac89f2-6906-4fbd-abf2-b3e95ea29462 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:46.038477 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6aac89f2-6906-4fbd-abf2-b3e95ea29462 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:46.045138 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6aac89f2-6906-4fbd-abf2-b3e95ea29462 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:46.045770 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6aac89f2-6906-4fbd-abf2-b3e95ea29462 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:46.046819 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6aac89f2-6906-4fbd-abf2-b3e95ea29462 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:46.047409 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6aac89f2-6906-4fbd-abf2-b3e95ea29462 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:46.146218 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6aac89f2-6906-4fbd-abf2-b3e95ea29462 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116142 May 26 20:27:46.155055 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 230/452] 10.222.0.44 () {58 vars in 1274 bytes} [Thu May 26 20:27:46 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:27:46.642114 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b3dfe262-fd57-493e-a5ce-35e118814594 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:46.642942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b3dfe262-fd57-493e-a5ce-35e118814594 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:46.652499 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3dfe262-fd57-493e-a5ce-35e118814594 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:46.653631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3dfe262-fd57-493e-a5ce-35e118814594 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:46.659387 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3dfe262-fd57-493e-a5ce-35e118814594 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:46.660071 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3dfe262-fd57-493e-a5ce-35e118814594 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:46.772150 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b3dfe262-fd57-493e-a5ce-35e118814594 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:46.784084 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b3dfe262-fd57-493e-a5ce-35e118814594 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1612 microversion: 2.1 time: 0.145309 May 26 20:27:46.785703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 223/453] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:46 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1612 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:46.956151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b036b702-8f3d-4b61-83b1-57b46dc03734 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:46.956642 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b036b702-8f3d-4b61-83b1-57b46dc03734 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:46.967952 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b036b702-8f3d-4b61-83b1-57b46dc03734 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:46.969721 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b036b702-8f3d-4b61-83b1-57b46dc03734 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:46.970734 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b036b702-8f3d-4b61-83b1-57b46dc03734 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:46.971506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b036b702-8f3d-4b61-83b1-57b46dc03734 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:47.037454 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-4c18cdbf-4895-4d1a-a9ba-f5b745bfa261 req-c0f25449-ed03-415f-b885-584ba6f15749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a2054d-de32-402c-8f6a-2f753925164d", "name": "network-vif-deleted", "tag": "22b9f953-2c86-4d1f-ac22-5abc810169c7"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:47.049896 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4c18cdbf-4895-4d1a-a9ba-f5b745bfa261 req-c0f25449-ed03-415f-b885-584ba6f15749 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:47.050635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-4c18cdbf-4895-4d1a-a9ba-f5b745bfa261 req-c0f25449-ed03-415f-b885-584ba6f15749 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:47.065779 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-4c18cdbf-4895-4d1a-a9ba-f5b745bfa261 req-c0f25449-ed03-415f-b885-584ba6f15749 service nova] Creating event network-vif-deleted:22b9f953-2c86-4d1f-ac22-5abc810169c7 for instance 91a2054d-de32-402c-8f6a-2f753925164d on hv-cinder-84213 May 26 20:27:47.071595 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-4c18cdbf-4895-4d1a-a9ba-f5b745bfa261 req-c0f25449-ed03-415f-b885-584ba6f15749 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038109 May 26 20:27:47.076842 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 224/454] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:27:47.155426 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-b036b702-8f3d-4b61-83b1-57b46dc03734 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lazy-loading 'services' on Instance uuid 48b85b88-9a19-473d-a08a-07d3a471dacc {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:27:47.381930 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b036b702-8f3d-4b61-83b1-57b46dc03734 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "DELETE /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc/os-volume_attachments/018afb4b-217a-4e84-bee5-9fb68a00149b" status: 202 len: 0 microversion: 2.1 time: 0.429778 May 26 20:27:47.383587 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 231/455] 10.222.0.44 () {58 vars in 1415 bytes} [Thu May 26 20:27:46 2022] DELETE /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc/os-volume_attachments/018afb4b-217a-4e84-bee5-9fb68a00149b => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:27:47.809565 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a907c724-659a-4732-8726-32ba4ac65b83 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:47.809565 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a907c724-659a-4732-8726-32ba4ac65b83 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:47.817784 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a907c724-659a-4732-8726-32ba4ac65b83 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:47.818232 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a907c724-659a-4732-8726-32ba4ac65b83 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:47.819041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a907c724-659a-4732-8726-32ba4ac65b83 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:47.819483 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a907c724-659a-4732-8726-32ba4ac65b83 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:47.872963 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a907c724-659a-4732-8726-32ba4ac65b83 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:47.873654 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a907c724-659a-4732-8726-32ba4ac65b83 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:47.874342 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-a907c724-659a-4732-8726-32ba4ac65b83 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lazy-loading 'fault' on Instance uuid 91a2054d-de32-402c-8f6a-2f753925164d {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:27:47.932991 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a907c724-659a-4732-8726-32ba4ac65b83 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:47.946588 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a907c724-659a-4732-8726-32ba4ac65b83 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 200 len: 1330 microversion: 2.1 time: 0.146445 May 26 20:27:47.947724 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 225/456] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:47 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 1330 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:48.031742 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-2745a07b-7bb5-4625-9b0e-8aa2f065a20d req-927b4de9-6ec5-4891-ba86-c2e4812b3fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6602854b-bca1-47cb-9307-9e01ce9e96d7", "tag": "fc329004-fdd7-4ee6-a7be-33d3addac5bc"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:48.047914 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-2745a07b-7bb5-4625-9b0e-8aa2f065a20d req-927b4de9-6ec5-4891-ba86-c2e4812b3fd2 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:48.048359 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-2745a07b-7bb5-4625-9b0e-8aa2f065a20d req-927b4de9-6ec5-4891-ba86-c2e4812b3fd2 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:48.061443 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-2745a07b-7bb5-4625-9b0e-8aa2f065a20d req-927b4de9-6ec5-4891-ba86-c2e4812b3fd2 service nova] Creating event network-changed:fc329004-fdd7-4ee6-a7be-33d3addac5bc for instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 on hv-cinder-84213 May 26 20:27:48.071054 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-2745a07b-7bb5-4625-9b0e-8aa2f065a20d req-927b4de9-6ec5-4891-ba86-c2e4812b3fd2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039890 May 26 20:27:48.071054 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 232/457] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:27:48.969000 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-25b2d946-8551-47c5-b136-ab65bb12a8db tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:48.969624 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-25b2d946-8551-47c5-b136-ab65bb12a8db tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:48.980222 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25b2d946-8551-47c5-b136-ab65bb12a8db tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:48.980762 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25b2d946-8551-47c5-b136-ab65bb12a8db tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:48.983052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25b2d946-8551-47c5-b136-ab65bb12a8db tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:48.983703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25b2d946-8551-47c5-b136-ab65bb12a8db tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:49.002537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-25b2d946-8551-47c5-b136-ab65bb12a8db tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-25b2d946-8551-47c5-b136-ab65bb12a8db tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d HTTP/1.1 May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:27:49.004647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:27:49.006174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:27:49.006174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:27:49.006174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:27:49.006174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:27:49.006174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:27:49.006174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:27:49.006174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:27:49.006174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:27:49.006174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:27:49.006174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:27:49.006174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:27:49.006174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '91a2054d-de32-402c-8f6a-2f753925164d'} May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:27:49.007097 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:27:49.008522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:49.013154 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-25b2d946-8551-47c5-b136-ab65bb12a8db tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 404 to user: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:27:49.014900 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-25b2d946-8551-47c5-b136-ab65bb12a8db tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 404 len: 111 microversion: 2.1 time: 0.052258 May 26 20:27:49.015909 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 226/458] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:48 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:27:49.036686 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-d3a3def6-8e68-4961-abb3-22fc4e87906a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '.version_select at 0x7f2da46b8dc0>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:49.138904 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-d3a3def6-8e68-4961-abb3-22fc4e87906a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-116663722" status: 202 len: 0 microversion: 2.1 time: 0.116207 May 26 20:27:49.139748 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 233/459] 10.222.0.44 () {58 vars in 1217 bytes} [Thu May 26 20:27:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-116663722 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:27:49.623199 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e9e43d32-c43f-43c8-a000-fd047596ebd9 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:49.624375 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e9e43d32-c43f-43c8-a000-fd047596ebd9 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:49.635283 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9e43d32-c43f-43c8-a000-fd047596ebd9 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:49.635877 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9e43d32-c43f-43c8-a000-fd047596ebd9 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:49.642618 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9e43d32-c43f-43c8-a000-fd047596ebd9 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:49.643166 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9e43d32-c43f-43c8-a000-fd047596ebd9 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:49.677704 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e9e43d32-c43f-43c8-a000-fd047596ebd9 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:27:50.029861 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e9e43d32-c43f-43c8-a000-fd047596ebd9 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "DELETE /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 204 len: 0 microversion: 2.1 time: 0.408709 May 26 20:27:50.031439 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 227/460] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:27:49 2022] DELETE /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:27:50.056432 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4264aee9-f537-42e4-9aaf-f5791f067009 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:50.062289 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4264aee9-f537-42e4-9aaf-f5791f067009 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:50.083827 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4264aee9-f537-42e4-9aaf-f5791f067009 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:50.085115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4264aee9-f537-42e4-9aaf-f5791f067009 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:50.086282 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4264aee9-f537-42e4-9aaf-f5791f067009 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:50.087021 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4264aee9-f537-42e4-9aaf-f5791f067009 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:50.088889 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-25cfdbf4-6e5a-4352-9879-df3d6e10da16 req-9bae20de-109e-4085-8487-b289cee0e0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6602854b-bca1-47cb-9307-9e01ce9e96d7", "tag": "fc329004-fdd7-4ee6-a7be-33d3addac5bc"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:50.112303 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-25cfdbf4-6e5a-4352-9879-df3d6e10da16 req-9bae20de-109e-4085-8487-b289cee0e0cf service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:50.113045 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-25cfdbf4-6e5a-4352-9879-df3d6e10da16 req-9bae20de-109e-4085-8487-b289cee0e0cf service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:50.131951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-25cfdbf4-6e5a-4352-9879-df3d6e10da16 req-9bae20de-109e-4085-8487-b289cee0e0cf service nova] Creating event network-changed:fc329004-fdd7-4ee6-a7be-33d3addac5bc for instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 on hv-cinder-84213 May 26 20:27:50.139633 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-25cfdbf4-6e5a-4352-9879-df3d6e10da16 req-9bae20de-109e-4085-8487-b289cee0e0cf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054599 May 26 20:27:50.140867 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 228/461] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:27:50.219843 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c96b3e94-c143-412d-a89e-5fc1294f5346 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: .version_select at 0x7f2da458f940>, body: {"keypair": {"name": "tempest-keypair-163588007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzmCmGwdn3sONu/pZud87EsJ23g3LVaYgJ0PkFCUqAhcsecS5/smBgO3rKYWrwu/u5QIwcPOjT7j716bXZiUVI7cWvGrUKuaZ9Jpw583oXR5htH0BS9SoURda11poe0NA=="}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:50.240814 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-c96b3e94-c143-412d-a89e-5fc1294f5346 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:27:50.245600 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-c96b3e94-c143-412d-a89e-5fc1294f5346 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for user f57c87dc60754d3aa87a84605c7a6889 and project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:27:50.297994 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4264aee9-f537-42e4-9aaf-f5791f067009 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:50.305604 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4264aee9-f537-42e4-9aaf-f5791f067009 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1514 microversion: 2.1 time: 0.261600 May 26 20:27:50.306191 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 234/462] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:50 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:50.403489 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c96b3e94-c143-412d-a89e-5fc1294f5346 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.188419 May 26 20:27:50.404359 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 229/463] 10.222.0.44 () {60 vars in 1158 bytes} [Thu May 26 20:27:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:27:51.322881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7e5b6877-9cc8-40e9-83a3-d3ad50a0d768 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:51.325102 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7e5b6877-9cc8-40e9-83a3-d3ad50a0d768 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:51.335529 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7e5b6877-9cc8-40e9-83a3-d3ad50a0d768 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:51.335984 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7e5b6877-9cc8-40e9-83a3-d3ad50a0d768 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:51.340250 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7e5b6877-9cc8-40e9-83a3-d3ad50a0d768 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:51.341949 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7e5b6877-9cc8-40e9-83a3-d3ad50a0d768 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:51.639599 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7e5b6877-9cc8-40e9-83a3-d3ad50a0d768 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:51.691346 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7e5b6877-9cc8-40e9-83a3-d3ad50a0d768 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1514 microversion: 2.1 time: 0.372216 May 26 20:27:51.704319 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 235/464] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:51 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1514 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:52.712027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a98309c9-c440-4715-86d2-f9e58399d831 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:52.712760 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a98309c9-c440-4715-86d2-f9e58399d831 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:52.723303 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a98309c9-c440-4715-86d2-f9e58399d831 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:52.724020 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a98309c9-c440-4715-86d2-f9e58399d831 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:52.724948 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a98309c9-c440-4715-86d2-f9e58399d831 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:52.725550 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a98309c9-c440-4715-86d2-f9e58399d831 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:53.047913 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a98309c9-c440-4715-86d2-f9e58399d831 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:53.063850 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a98309c9-c440-4715-86d2-f9e58399d831 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1514 microversion: 2.1 time: 0.356175 May 26 20:27:53.069837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 230/465] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:52 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1514 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:53.363834 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-f897b72f-4532-47cd-a210-2b8c80745cfa req-3e320ae7-a13c-4402-b5d5-6c9d7d4bc6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b85b88-9a19-473d-a08a-07d3a471dacc", "name": "network-vif-deleted", "tag": "04e52dc1-16de-4010-be95-99bce2c747aa"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:53.374352 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-f897b72f-4532-47cd-a210-2b8c80745cfa req-3e320ae7-a13c-4402-b5d5-6c9d7d4bc6e1 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:53.377711 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-f897b72f-4532-47cd-a210-2b8c80745cfa req-3e320ae7-a13c-4402-b5d5-6c9d7d4bc6e1 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:53.388989 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-f897b72f-4532-47cd-a210-2b8c80745cfa req-3e320ae7-a13c-4402-b5d5-6c9d7d4bc6e1 service nova] Creating event network-vif-deleted:04e52dc1-16de-4010-be95-99bce2c747aa for instance 48b85b88-9a19-473d-a08a-07d3a471dacc on hv-cinder-84213 May 26 20:27:53.394384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-f897b72f-4532-47cd-a210-2b8c80745cfa req-3e320ae7-a13c-4402-b5d5-6c9d7d4bc6e1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034563 May 26 20:27:53.398059 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 236/466] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:27:54.083026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-478ad60a-1846-4ebe-bd75-de1b7f92d7d8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:54.083699 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-478ad60a-1846-4ebe-bd75-de1b7f92d7d8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:54.094907 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-478ad60a-1846-4ebe-bd75-de1b7f92d7d8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:54.095360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-478ad60a-1846-4ebe-bd75-de1b7f92d7d8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:54.099200 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-478ad60a-1846-4ebe-bd75-de1b7f92d7d8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:54.099799 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-478ad60a-1846-4ebe-bd75-de1b7f92d7d8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:54.165422 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-478ad60a-1846-4ebe-bd75-de1b7f92d7d8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:54.166465 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-478ad60a-1846-4ebe-bd75-de1b7f92d7d8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:54.167394 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-478ad60a-1846-4ebe-bd75-de1b7f92d7d8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lazy-loading 'fault' on Instance uuid 48b85b88-9a19-473d-a08a-07d3a471dacc {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:27:54.229260 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-478ad60a-1846-4ebe-bd75-de1b7f92d7d8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd005cfcbb5e04a1084857e89a42921f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7deb3c965bb427eb4a9753cd21bca05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:54.240138 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-478ad60a-1846-4ebe-bd75-de1b7f92d7d8 tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 200 len: 1309 microversion: 2.1 time: 0.161705 May 26 20:27:54.254068 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 231/467] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:54 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 1309 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:54.493948 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-311282166", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d8f9587-b15f-4a25-9b7c-c72960c971d6"}], "security_groups": [{"name": "tempest-securitygroup--391640516"}], "key_name": "tempest-keypair-163588007", "user_data": "}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:27:54.500860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:54.693117 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.network.neutron [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] validate_networks() for [('0d8f9587-b15f-4a25-9b7c-c72960c971d6', None, None, None, None, None)] {{(pid=118306) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:27:55.260939 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f9771fdb-21da-4af7-8cac-2b5071bc60ee tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:55.262176 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f9771fdb-21da-4af7-8cac-2b5071bc60ee tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] [instance: 48b85b88-9a19-473d-a08a-07d3a471dacc] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:55.268081 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:55.270077 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9771fdb-21da-4af7-8cac-2b5071bc60ee tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:55.270734 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9771fdb-21da-4af7-8cac-2b5071bc60ee tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:55.271513 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9771fdb-21da-4af7-8cac-2b5071bc60ee tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:55.271947 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f9771fdb-21da-4af7-8cac-2b5071bc60ee tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:55.286522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-f9771fdb-21da-4af7-8cac-2b5071bc60ee tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] HTTP exception thrown: Instance 48b85b88-9a19-473d-a08a-07d3a471dacc could not be found. May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f9771fdb-21da-4af7-8cac-2b5071bc60ee tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Request method failure captured: May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc HTTP/1.1 May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-I2I1F7QMkBJ6SWuarWlk80k3P-yoZO_YeRqStKUk0XsVekJqHMUJVbvPHjiukFVloUGlnHLvctd071bpV4l9uz_PEWdpEuZt8bqoDA_wTpz3SecjxITj2epBV0Q93OhgI727L2sXfZk5H3VIkmrRW3aHcIVU8O8PWPKJwGnMn09rQ May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: c7deb3c965bb427eb4a9753cd21bca05 May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesSnapshotTestJSON-345106894 May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:27:55.288582 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:27:55.290125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c7deb3c965bb427eb4a9753cd21bca05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c7deb3c965bb427eb4a9753cd21bca05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c7deb3c965bb427eb4a9753cd21bca05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c7deb3c965bb427eb4a9753cd21bca05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:27:55.290125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-VolumesSnapshotTestJSON-345106894 May 26 20:27:55.290125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: c7deb3c965bb427eb4a9753cd21bca05 May 26 20:27:55.290125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-345106894 May 26 20:27:55.290125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-VolumesSnapshotTestJSON-345106894-project May 26 20:27:55.290125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:27:55.290125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:27:55.290125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: d005cfcbb5e04a1084857e89a42921f9 May 26 20:27:55.290125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-VolumesSnapshotTestJSON-345106894-project May 26 20:27:55.290125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:27:55.290125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 48b85b88-9a19-473d-a08a-07d3a471dacc could not be found. May 26 20:27:55.290125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '48b85b88-9a19-473d-a08a-07d3a471dacc'} May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b85b88-9a19-473d-a08a-07d3a471dacc could not be found. May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:27:55.290905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b85b88-9a19-473d-a08a-07d3a471dacc could not be found. May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b85b88-9a19-473d-a08a-07d3a471dacc could not be found. May 26 20:27:55.292274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:27:55.295109 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f9771fdb-21da-4af7-8cac-2b5071bc60ee tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] Returning 404 to user: Instance 48b85b88-9a19-473d-a08a-07d3a471dacc could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:27:55.295977 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f9771fdb-21da-4af7-8cac-2b5071bc60ee tempest-VolumesSnapshotTestJSON-345106894 tempest-VolumesSnapshotTestJSON-345106894-project] 10.222.0.44 "GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc" status: 404 len: 111 microversion: 2.1 time: 0.038939 May 26 20:27:55.296550 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 232/468] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:55 2022] GET /compute/v2.1/servers/48b85b88-9a19-473d-a08a-07d3a471dacc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 20:27:55.686733 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Flavor limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:27:55.687239 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Image limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:27:55.687608 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Flavor pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:27:55.688010 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Image pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:27:55.688568 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:27:55.698463 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:55.700875 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:55.700875 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:55.700875 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:55.719264 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:27:55.723666 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for user f57c87dc60754d3aa87a84605c7a6889 and project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:27:55.736360 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Going to run 1 instances... {{(pid=118306) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:27:55.739335 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:27:55.923309 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-67f5b8ed-f321-4ade-a7b3-bd79a527f25c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.434466 May 26 20:27:55.930180 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 237/469] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:27:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:27:55.935389 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5c917883-16a7-4e45-883d-8e88c797a67a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:55.936081 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5c917883-16a7-4e45-883d-8e88c797a67a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:56.013499 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5c917883-16a7-4e45-883d-8e88c797a67a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:56.029063 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5c917883-16a7-4e45-883d-8e88c797a67a tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1240 microversion: 2.1 time: 0.096881 May 26 20:27:56.039351 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 233/470] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:55 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:27:57.053313 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-43f3db96-527f-4c7b-ab7a-f34ba1e96556 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:57.055677 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-43f3db96-527f-4c7b-ab7a-f34ba1e96556 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:57.066396 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-43f3db96-527f-4c7b-ab7a-f34ba1e96556 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:57.067280 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-43f3db96-527f-4c7b-ab7a-f34ba1e96556 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:57.068219 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-43f3db96-527f-4c7b-ab7a-f34ba1e96556 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:57.068818 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-43f3db96-527f-4c7b-ab7a-f34ba1e96556 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:57.158446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-43f3db96-527f-4c7b-ab7a-f34ba1e96556 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:57.166782 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-43f3db96-527f-4c7b-ab7a-f34ba1e96556 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1244 microversion: 2.1 time: 0.118463 May 26 20:27:57.186722 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 238/471] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:57 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1244 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:58.190154 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2c133606-b8df-4b9e-8c23-57cb6ff1a446 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:58.190801 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2c133606-b8df-4b9e-8c23-57cb6ff1a446 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:58.201307 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c133606-b8df-4b9e-8c23-57cb6ff1a446 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:58.206451 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c133606-b8df-4b9e-8c23-57cb6ff1a446 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:58.206451 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c133606-b8df-4b9e-8c23-57cb6ff1a446 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:58.206451 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c133606-b8df-4b9e-8c23-57cb6ff1a446 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:58.296598 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2c133606-b8df-4b9e-8c23-57cb6ff1a446 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:58.305935 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2c133606-b8df-4b9e-8c23-57cb6ff1a446 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1292 microversion: 2.1 time: 0.125123 May 26 20:27:58.307322 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 234/472] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:58 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1292 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:27:59.323804 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8e16388a-08a9-44ab-b0da-0666b32ea2d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:27:59.327479 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8e16388a-08a9-44ab-b0da-0666b32ea2d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:27:59.341739 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8e16388a-08a9-44ab-b0da-0666b32ea2d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:59.347984 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8e16388a-08a9-44ab-b0da-0666b32ea2d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:59.349093 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8e16388a-08a9-44ab-b0da-0666b32ea2d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:27:59.349679 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8e16388a-08a9-44ab-b0da-0666b32ea2d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:27:59.478795 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8e16388a-08a9-44ab-b0da-0666b32ea2d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:27:59.490842 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8e16388a-08a9-44ab-b0da-0666b32ea2d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1292 microversion: 2.1 time: 0.171023 May 26 20:27:59.491775 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 239/473] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:27:59 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1292 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:00.518986 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-23d04477-8343-4ba6-bf0c-6a5ce1e88919 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:00.519500 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-23d04477-8343-4ba6-bf0c-6a5ce1e88919 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:00.535352 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23d04477-8343-4ba6-bf0c-6a5ce1e88919 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:00.535771 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23d04477-8343-4ba6-bf0c-6a5ce1e88919 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:00.536601 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23d04477-8343-4ba6-bf0c-6a5ce1e88919 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:00.537045 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-23d04477-8343-4ba6-bf0c-6a5ce1e88919 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:00.625738 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-23d04477-8343-4ba6-bf0c-6a5ce1e88919 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:00.633435 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-23d04477-8343-4ba6-bf0c-6a5ce1e88919 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1292 microversion: 2.1 time: 0.128783 May 26 20:28:00.634541 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 235/474] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:00 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1292 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:01.651331 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-fd68faea-72fd-4354-9eb1-8e3ab7f2c0f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:01.651948 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-fd68faea-72fd-4354-9eb1-8e3ab7f2c0f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:01.659487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fd68faea-72fd-4354-9eb1-8e3ab7f2c0f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:01.660039 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fd68faea-72fd-4354-9eb1-8e3ab7f2c0f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:01.660818 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fd68faea-72fd-4354-9eb1-8e3ab7f2c0f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:01.661254 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fd68faea-72fd-4354-9eb1-8e3ab7f2c0f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:01.901425 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-fd68faea-72fd-4354-9eb1-8e3ab7f2c0f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:01.930347 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-fd68faea-72fd-4354-9eb1-8e3ab7f2c0f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1365 microversion: 2.1 time: 0.282695 May 26 20:28:01.940733 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 240/475] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:01 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1365 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:02.953246 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c4dd6f2e-75bd-4684-9a0c-fab6438b37b8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:02.955161 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c4dd6f2e-75bd-4684-9a0c-fab6438b37b8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:02.962462 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c4dd6f2e-75bd-4684-9a0c-fab6438b37b8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:02.963054 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c4dd6f2e-75bd-4684-9a0c-fab6438b37b8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:02.964130 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c4dd6f2e-75bd-4684-9a0c-fab6438b37b8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:02.964736 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c4dd6f2e-75bd-4684-9a0c-fab6438b37b8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:03.137119 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-6846eae6-1181-4494-a34e-3128c23116a0 req-f59a4df5-931f-4c3e-9139-49e732c1df7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931728fa-007b-4441-97c1-602ae434cf8a", "tag": "2a052563-e94a-47d5-8122-1456154565da"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:03.157821 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-6846eae6-1181-4494-a34e-3128c23116a0 req-f59a4df5-931f-4c3e-9139-49e732c1df7b service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:03.158774 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-6846eae6-1181-4494-a34e-3128c23116a0 req-f59a4df5-931f-4c3e-9139-49e732c1df7b service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:03.182229 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-6846eae6-1181-4494-a34e-3128c23116a0 req-f59a4df5-931f-4c3e-9139-49e732c1df7b service nova] Creating event network-changed:2a052563-e94a-47d5-8122-1456154565da for instance 931728fa-007b-4441-97c1-602ae434cf8a on hv-cinder-84213 May 26 20:28:03.206234 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-6846eae6-1181-4494-a34e-3128c23116a0 req-f59a4df5-931f-4c3e-9139-49e732c1df7b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072507 May 26 20:28:03.210081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 241/476] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:03.258612 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c4dd6f2e-75bd-4684-9a0c-fab6438b37b8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:03.275078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c4dd6f2e-75bd-4684-9a0c-fab6438b37b8 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1365 microversion: 2.1 time: 0.330674 May 26 20:28:03.285758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 236/477] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:02 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:04.294672 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e452ce3f-b55e-43c3-8aac-77dc80d58d35 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:04.296039 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e452ce3f-b55e-43c3-8aac-77dc80d58d35 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:04.303535 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e452ce3f-b55e-43c3-8aac-77dc80d58d35 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:04.304633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e452ce3f-b55e-43c3-8aac-77dc80d58d35 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:04.305400 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e452ce3f-b55e-43c3-8aac-77dc80d58d35 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:04.305833 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e452ce3f-b55e-43c3-8aac-77dc80d58d35 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:04.467054 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e452ce3f-b55e-43c3-8aac-77dc80d58d35 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:04.470789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:04.476184 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e452ce3f-b55e-43c3-8aac-77dc80d58d35 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1365 microversion: 2.1 time: 0.187180 May 26 20:28:04.476751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 242/478] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:04 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:05.493907 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6a5ec8d7-a32d-433a-9975-6351a58b84f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:05.494596 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6a5ec8d7-a32d-433a-9975-6351a58b84f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:05.508145 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6a5ec8d7-a32d-433a-9975-6351a58b84f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:05.508842 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6a5ec8d7-a32d-433a-9975-6351a58b84f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:05.509829 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6a5ec8d7-a32d-433a-9975-6351a58b84f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:05.510281 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6a5ec8d7-a32d-433a-9975-6351a58b84f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:05.671254 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6a5ec8d7-a32d-433a-9975-6351a58b84f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:05.682959 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6a5ec8d7-a32d-433a-9975-6351a58b84f6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1365 microversion: 2.1 time: 0.193856 May 26 20:28:05.684850 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 237/479] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:05 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:06.701979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-d29941af-c95f-4b21-bbd8-c540b2281b72 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:06.702664 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-d29941af-c95f-4b21-bbd8-c540b2281b72 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:06.705544 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:06.706837 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=6 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:06.714447 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d29941af-c95f-4b21-bbd8-c540b2281b72 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:06.715630 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d29941af-c95f-4b21-bbd8-c540b2281b72 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:06.716944 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d29941af-c95f-4b21-bbd8-c540b2281b72 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:06.717503 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d29941af-c95f-4b21-bbd8-c540b2281b72 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:06.890139 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-d29941af-c95f-4b21-bbd8-c540b2281b72 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:06.897681 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-d29941af-c95f-4b21-bbd8-c540b2281b72 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1365 microversion: 2.1 time: 0.200828 May 26 20:28:06.898303 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 243/480] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:06 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:07.914738 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e66d1441-0df4-43d1-95b3-4468f681dd73 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:07.915404 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e66d1441-0df4-43d1-95b3-4468f681dd73 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:07.917229 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:07.923376 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e66d1441-0df4-43d1-95b3-4468f681dd73 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:07.923831 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e66d1441-0df4-43d1-95b3-4468f681dd73 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:07.924603 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e66d1441-0df4-43d1-95b3-4468f681dd73 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:07.925045 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e66d1441-0df4-43d1-95b3-4468f681dd73 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:07.929410 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:08.058090 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e66d1441-0df4-43d1-95b3-4468f681dd73 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:08.065762 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e66d1441-0df4-43d1-95b3-4468f681dd73 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1365 microversion: 2.1 time: 0.154933 May 26 20:28:08.066454 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 238/481] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:07 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:08.089286 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-97a3492f-8157-4423-a17b-ff3da7dff07d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Action: 'create', calling method: .version_select at 0x7f2da4490430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-446495996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAKh1r9NaxX5a0TuY4WjQhhbM0bpYTlwti0unFmgRfucYzDLruSNftk2UzuLHf7GyhDe1Nxx/9ToVs8Vwb6t3c9qOxfcLJK5H63VEf0qOqGHLvrT/WpICUX/dzzCIyFjw=="}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:08.106008 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-97a3492f-8157-4423-a17b-ff3da7dff07d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Getting quotas for project 437e2c484c1d4accb95b3787fd921363. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:28:08.109800 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-97a3492f-8157-4423-a17b-ff3da7dff07d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Getting quotas for user 0218a775ec8d415f924b34bcd40f87e6 and project 437e2c484c1d4accb95b3787fd921363. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:28:08.217314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-97a3492f-8157-4423-a17b-ff3da7dff07d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.132329 May 26 20:28:08.217838 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 244/482] 10.222.0.44 () {60 vars in 1158 bytes} [Thu May 26 20:28:08 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:08.266229 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-459112628", "imageRef": "7fa7aa89-4015-469d-bdb5-637b13a25186", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-446495996", "networks": [{"uuid": "c7ffd9b8-5e3d-4687-8d2e-fb3cd8fa7110"}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:08.316067 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] validate_networks() for [('c7ffd9b8-5e3d-4687-8d2e-fb3cd8fa7110', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:28:08.676414 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:28:08.676840 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:28:08.677316 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:28:08.677727 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:28:08.678141 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:28:08.688307 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:08.688756 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:08.689563 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:08.690009 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:08.707069 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Getting quotas for project 437e2c484c1d4accb95b3787fd921363. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:28:08.711067 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Getting quotas for user 0218a775ec8d415f924b34bcd40f87e6 and project 437e2c484c1d4accb95b3787fd921363. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:28:08.722522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:28:08.724874 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fa7aa89-4015-469d-bdb5-637b13a25186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:28:08.823906 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2c6f8333-2b3c-4370-bc3f-142690bcc3ed tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563085 May 26 20:28:08.824505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 239/483] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:28:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:28:08.834365 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4be3df54-06ad-42b9-9c94-871c639fa081 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:08.834975 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4be3df54-06ad-42b9-9c94-871c639fa081 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:08.891680 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4be3df54-06ad-42b9-9c94-871c639fa081 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:08.898401 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4be3df54-06ad-42b9-9c94-871c639fa081 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1257 microversion: 2.1 time: 0.067842 May 26 20:28:08.898978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 245/484] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:08 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:09.083444 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9f644a6d-d2da-4f9f-a58d-3b0b716e959c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:09.083986 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9f644a6d-d2da-4f9f-a58d-3b0b716e959c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:09.091393 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9f644a6d-d2da-4f9f-a58d-3b0b716e959c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:09.092081 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9f644a6d-d2da-4f9f-a58d-3b0b716e959c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:09.092852 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9f644a6d-d2da-4f9f-a58d-3b0b716e959c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:09.093289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9f644a6d-d2da-4f9f-a58d-3b0b716e959c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:09.226608 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9f644a6d-d2da-4f9f-a58d-3b0b716e959c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:09.234720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9f644a6d-d2da-4f9f-a58d-3b0b716e959c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1365 microversion: 2.1 time: 0.155768 May 26 20:28:09.235287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 240/485] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:09 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:09.915954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-15f0d37b-cbbb-467b-8774-d5fce1ba7bbc tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:09.916562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-15f0d37b-cbbb-467b-8774-d5fce1ba7bbc tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:09.924690 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-15f0d37b-cbbb-467b-8774-d5fce1ba7bbc tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:09.925125 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-15f0d37b-cbbb-467b-8774-d5fce1ba7bbc tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:09.925874 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-15f0d37b-cbbb-467b-8774-d5fce1ba7bbc tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:09.926332 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-15f0d37b-cbbb-467b-8774-d5fce1ba7bbc tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:09.987424 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-15f0d37b-cbbb-467b-8774-d5fce1ba7bbc tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:09.995005 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-15f0d37b-cbbb-467b-8774-d5fce1ba7bbc tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1261 microversion: 2.1 time: 0.082972 May 26 20:28:09.995564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 246/486] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:09 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:10.251233 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6785b8eb-e39f-4915-9d93-c9b27056226b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:10.251768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6785b8eb-e39f-4915-9d93-c9b27056226b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:10.257728 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6785b8eb-e39f-4915-9d93-c9b27056226b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:10.258171 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6785b8eb-e39f-4915-9d93-c9b27056226b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:10.258955 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6785b8eb-e39f-4915-9d93-c9b27056226b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:10.259389 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6785b8eb-e39f-4915-9d93-c9b27056226b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:10.386344 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6785b8eb-e39f-4915-9d93-c9b27056226b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:10.394822 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6785b8eb-e39f-4915-9d93-c9b27056226b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1365 microversion: 2.1 time: 0.148172 May 26 20:28:10.395420 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 241/487] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:10 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:11.003758 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-4991a67f-6006-404b-9c21-477a99970bd9 req-89505660-bbd3-4066-bfe1-b8f657553576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931728fa-007b-4441-97c1-602ae434cf8a", "name": "network-vif-plugged", "status": "completed", "tag": "2a052563-e94a-47d5-8122-1456154565da"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:11.012146 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a16c43ef-def4-4ccf-948b-2fa1e88f4a0b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:11.012762 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a16c43ef-def4-4ccf-948b-2fa1e88f4a0b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:11.019056 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a16c43ef-def4-4ccf-948b-2fa1e88f4a0b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:11.019442 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a16c43ef-def4-4ccf-948b-2fa1e88f4a0b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:11.020355 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a16c43ef-def4-4ccf-948b-2fa1e88f4a0b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:11.020801 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a16c43ef-def4-4ccf-948b-2fa1e88f4a0b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:11.021444 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-4991a67f-6006-404b-9c21-477a99970bd9 req-89505660-bbd3-4066-bfe1-b8f657553576 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:11.021877 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-4991a67f-6006-404b-9c21-477a99970bd9 req-89505660-bbd3-4066-bfe1-b8f657553576 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:11.033281 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-4991a67f-6006-404b-9c21-477a99970bd9 req-89505660-bbd3-4066-bfe1-b8f657553576 service nova] Creating event network-vif-plugged:2a052563-e94a-47d5-8122-1456154565da for instance 931728fa-007b-4441-97c1-602ae434cf8a on hv-cinder-84213 May 26 20:28:11.038976 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-4991a67f-6006-404b-9c21-477a99970bd9 req-89505660-bbd3-4066-bfe1-b8f657553576 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040048 May 26 20:28:11.039589 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 247/488] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:11.086523 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a16c43ef-def4-4ccf-948b-2fa1e88f4a0b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:11.094573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a16c43ef-def4-4ccf-948b-2fa1e88f4a0b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1309 microversion: 2.1 time: 0.086256 May 26 20:28:11.095337 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 242/489] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:11 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:28:11.413177 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-18cffe41-0fcc-4d74-82d2-3560173ed30f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:11.413863 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-18cffe41-0fcc-4d74-82d2-3560173ed30f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:11.420644 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-18cffe41-0fcc-4d74-82d2-3560173ed30f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:11.421083 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-18cffe41-0fcc-4d74-82d2-3560173ed30f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:11.421835 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-18cffe41-0fcc-4d74-82d2-3560173ed30f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:11.422284 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-18cffe41-0fcc-4d74-82d2-3560173ed30f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:11.557293 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-18cffe41-0fcc-4d74-82d2-3560173ed30f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:11.565129 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-18cffe41-0fcc-4d74-82d2-3560173ed30f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1365 microversion: 2.1 time: 0.156132 May 26 20:28:11.565714 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 248/490] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:11 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:12.123969 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9cc9bb60-ee14-4e59-a920-3835ee7f3cec tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:12.123969 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9cc9bb60-ee14-4e59-a920-3835ee7f3cec tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:12.129391 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9cc9bb60-ee14-4e59-a920-3835ee7f3cec tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:12.133962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9cc9bb60-ee14-4e59-a920-3835ee7f3cec tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:12.138929 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9cc9bb60-ee14-4e59-a920-3835ee7f3cec tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:12.139429 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9cc9bb60-ee14-4e59-a920-3835ee7f3cec tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:12.223723 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9cc9bb60-ee14-4e59-a920-3835ee7f3cec tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:12.231907 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9cc9bb60-ee14-4e59-a920-3835ee7f3cec tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1327 microversion: 2.1 time: 0.119104 May 26 20:28:12.233361 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 243/491] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:12 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:12.582901 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-04361900-362d-4201-91f2-ff2e35f1f2d4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:12.583556 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-04361900-362d-4201-91f2-ff2e35f1f2d4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:12.592565 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-04361900-362d-4201-91f2-ff2e35f1f2d4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:12.593129 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-04361900-362d-4201-91f2-ff2e35f1f2d4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:12.594005 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-04361900-362d-4201-91f2-ff2e35f1f2d4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:12.594753 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-04361900-362d-4201-91f2-ff2e35f1f2d4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:12.744350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-04361900-362d-4201-91f2-ff2e35f1f2d4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:12.749027 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-04361900-362d-4201-91f2-ff2e35f1f2d4 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1365 microversion: 2.1 time: 0.170043 May 26 20:28:12.749605 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 249/492] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:12 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:13.249908 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-75330924-1cd1-4522-a268-45a8d0cbe95d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:13.250915 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-75330924-1cd1-4522-a268-45a8d0cbe95d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:13.258511 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75330924-1cd1-4522-a268-45a8d0cbe95d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:13.259051 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75330924-1cd1-4522-a268-45a8d0cbe95d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:13.260076 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75330924-1cd1-4522-a268-45a8d0cbe95d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:13.260904 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75330924-1cd1-4522-a268-45a8d0cbe95d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:13.419124 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-75330924-1cd1-4522-a268-45a8d0cbe95d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:13.429232 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-75330924-1cd1-4522-a268-45a8d0cbe95d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.182717 May 26 20:28:13.429232 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 244/493] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:13 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:13.767099 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-64ef7478-c79a-4be9-af84-2618d6e910a1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:13.767869 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-64ef7478-c79a-4be9-af84-2618d6e910a1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:13.775584 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-64ef7478-c79a-4be9-af84-2618d6e910a1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:13.776433 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-64ef7478-c79a-4be9-af84-2618d6e910a1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:13.777287 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-64ef7478-c79a-4be9-af84-2618d6e910a1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:13.779287 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-64ef7478-c79a-4be9-af84-2618d6e910a1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:13.926111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-64ef7478-c79a-4be9-af84-2618d6e910a1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:13.937474 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-64ef7478-c79a-4be9-af84-2618d6e910a1 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1554 microversion: 2.1 time: 0.175148 May 26 20:28:13.938086 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 250/494] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:13 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:13.959956 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a302d4ca-46e8-45cd-b0d2-5d190aeec3fc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:13.960844 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a302d4ca-46e8-45cd-b0d2-5d190aeec3fc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:13.967515 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a302d4ca-46e8-45cd-b0d2-5d190aeec3fc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:13.967968 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a302d4ca-46e8-45cd-b0d2-5d190aeec3fc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:13.969005 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a302d4ca-46e8-45cd-b0d2-5d190aeec3fc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:13.969676 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a302d4ca-46e8-45cd-b0d2-5d190aeec3fc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:14.054835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a302d4ca-46e8-45cd-b0d2-5d190aeec3fc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098707 May 26 20:28:14.055580 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 245/495] 10.222.0.44 () {58 vars in 1274 bytes} [Thu May 26 20:28:13 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:14.444887 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-16a6391d-3425-4363-8a8a-e21859effe9a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:14.445507 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-16a6391d-3425-4363-8a8a-e21859effe9a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:14.453023 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-16a6391d-3425-4363-8a8a-e21859effe9a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:14.454321 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-16a6391d-3425-4363-8a8a-e21859effe9a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:14.455437 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-16a6391d-3425-4363-8a8a-e21859effe9a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:14.456099 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-16a6391d-3425-4363-8a8a-e21859effe9a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:14.688850 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-16a6391d-3425-4363-8a8a-e21859effe9a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:14.697584 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-16a6391d-3425-4363-8a8a-e21859effe9a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.256354 May 26 20:28:14.698081 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 251/496] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:14 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:15.243901 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-3c0ed0be-947d-446a-811d-bcd6a623151a req-15e5ad16-56c3-4518-a1f7-f8df618072f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931728fa-007b-4441-97c1-602ae434cf8a", "tag": "2a052563-e94a-47d5-8122-1456154565da"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:15.259492 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3c0ed0be-947d-446a-811d-bcd6a623151a req-15e5ad16-56c3-4518-a1f7-f8df618072f2 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:15.263076 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3c0ed0be-947d-446a-811d-bcd6a623151a req-15e5ad16-56c3-4518-a1f7-f8df618072f2 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:15.282997 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-3c0ed0be-947d-446a-811d-bcd6a623151a req-15e5ad16-56c3-4518-a1f7-f8df618072f2 service nova] Creating event network-changed:2a052563-e94a-47d5-8122-1456154565da for instance 931728fa-007b-4441-97c1-602ae434cf8a on hv-cinder-84213 May 26 20:28:15.288388 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-3c0ed0be-947d-446a-811d-bcd6a623151a req-15e5ad16-56c3-4518-a1f7-f8df618072f2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048613 May 26 20:28:15.289093 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 246/497] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:15.714951 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7decc01c-5e24-4cf2-a033-6b98054e6dfa tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:15.716979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7decc01c-5e24-4cf2-a033-6b98054e6dfa tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:15.723953 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7decc01c-5e24-4cf2-a033-6b98054e6dfa tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:15.724643 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7decc01c-5e24-4cf2-a033-6b98054e6dfa tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:15.725440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7decc01c-5e24-4cf2-a033-6b98054e6dfa tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:15.725868 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7decc01c-5e24-4cf2-a033-6b98054e6dfa tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:15.955758 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7decc01c-5e24-4cf2-a033-6b98054e6dfa tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:15.965160 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7decc01c-5e24-4cf2-a033-6b98054e6dfa tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.254418 May 26 20:28:15.968873 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 252/498] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:15 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:28:16.986599 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-aeedab4f-bec9-4bc4-b637-78abb6dee6bf tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:16.999466 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-aeedab4f-bec9-4bc4-b637-78abb6dee6bf tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:16.999466 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aeedab4f-bec9-4bc4-b637-78abb6dee6bf tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:16.999466 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aeedab4f-bec9-4bc4-b637-78abb6dee6bf tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:16.999466 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aeedab4f-bec9-4bc4-b637-78abb6dee6bf tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:17.000006 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aeedab4f-bec9-4bc4-b637-78abb6dee6bf tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:17.180098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-aeedab4f-bec9-4bc4-b637-78abb6dee6bf tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:17.191165 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-aeedab4f-bec9-4bc4-b637-78abb6dee6bf tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.209785 May 26 20:28:17.191993 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 247/499] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:16 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:18.209637 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-583f5e21-46fb-4b4c-a787-c60b7331298d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:18.210256 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-583f5e21-46fb-4b4c-a787-c60b7331298d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:18.219163 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-583f5e21-46fb-4b4c-a787-c60b7331298d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:18.219620 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-583f5e21-46fb-4b4c-a787-c60b7331298d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:18.220407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-583f5e21-46fb-4b4c-a787-c60b7331298d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:18.220843 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-583f5e21-46fb-4b4c-a787-c60b7331298d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:18.371412 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-583f5e21-46fb-4b4c-a787-c60b7331298d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:18.379815 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-583f5e21-46fb-4b4c-a787-c60b7331298d tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.174020 May 26 20:28:18.380399 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 253/500] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:18 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:19.397428 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-dffb7267-f4d5-42f7-8e29-53597e823e6f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:19.398179 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dffb7267-f4d5-42f7-8e29-53597e823e6f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:19.400653 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:19.401306 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:19.406859 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dffb7267-f4d5-42f7-8e29-53597e823e6f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:19.410217 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dffb7267-f4d5-42f7-8e29-53597e823e6f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:19.410217 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dffb7267-f4d5-42f7-8e29-53597e823e6f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:19.410217 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dffb7267-f4d5-42f7-8e29-53597e823e6f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:19.548419 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-dffb7267-f4d5-42f7-8e29-53597e823e6f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:19.560379 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-dffb7267-f4d5-42f7-8e29-53597e823e6f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.166918 May 26 20:28:19.561256 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 248/501] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:19 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:20.577578 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-31553017-8762-48bf-b8fe-b237d1addf13 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:20.578171 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-31553017-8762-48bf-b8fe-b237d1addf13 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:20.580051 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=6 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:20.585499 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-31553017-8762-48bf-b8fe-b237d1addf13 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:20.585977 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-31553017-8762-48bf-b8fe-b237d1addf13 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:20.586838 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-31553017-8762-48bf-b8fe-b237d1addf13 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:20.587316 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-31553017-8762-48bf-b8fe-b237d1addf13 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:20.725356 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-31553017-8762-48bf-b8fe-b237d1addf13 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:20.732856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-31553017-8762-48bf-b8fe-b237d1addf13 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.159281 May 26 20:28:20.733433 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 254/502] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:20 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:21.750645 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2c30d53b-13f1-45e0-9489-ce018a309ee6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:21.751451 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2c30d53b-13f1-45e0-9489-ce018a309ee6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:21.758268 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c30d53b-13f1-45e0-9489-ce018a309ee6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:21.760855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c30d53b-13f1-45e0-9489-ce018a309ee6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:21.760855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c30d53b-13f1-45e0-9489-ce018a309ee6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:21.760855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c30d53b-13f1-45e0-9489-ce018a309ee6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:22.107798 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2c30d53b-13f1-45e0-9489-ce018a309ee6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:22.115134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2c30d53b-13f1-45e0-9489-ce018a309ee6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.369508 May 26 20:28:22.115704 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 249/503] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:21 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:22.829239 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a6e62e79-ed90-4ebc-9400-e3f2ce224fb8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:22.830166 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a6e62e79-ed90-4ebc-9400-e3f2ce224fb8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:22.836839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a6e62e79-ed90-4ebc-9400-e3f2ce224fb8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:22.837940 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a6e62e79-ed90-4ebc-9400-e3f2ce224fb8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:22.838795 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a6e62e79-ed90-4ebc-9400-e3f2ce224fb8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:22.839295 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a6e62e79-ed90-4ebc-9400-e3f2ce224fb8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:22.870958 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a6e62e79-ed90-4ebc-9400-e3f2ce224fb8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045824 May 26 20:28:22.871541 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 255/504] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:28:22 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 20:28:22.885731 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-e8f58f9a-5f73-47ea-856c-44560603b6ce req-80586b68-bc19-4980-86dd-9fb190c013e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6f1ba5-371c-4465-8534-2eb1ef60acdb", "tag": "a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:22.900796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e8f58f9a-5f73-47ea-856c-44560603b6ce req-80586b68-bc19-4980-86dd-9fb190c013e1 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:22.901245 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e8f58f9a-5f73-47ea-856c-44560603b6ce req-80586b68-bc19-4980-86dd-9fb190c013e1 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:22.923036 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-e8f58f9a-5f73-47ea-856c-44560603b6ce req-80586b68-bc19-4980-86dd-9fb190c013e1 service nova] Creating event network-changed:a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d for instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb on hv-cinder-84213 May 26 20:28:22.926344 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-e8f58f9a-5f73-47ea-856c-44560603b6ce req-80586b68-bc19-4980-86dd-9fb190c013e1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044240 May 26 20:28:22.927145 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 250/505] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:22.963536 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b386b77e-6b78-4463-b9cb-a225de3aa809 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:22.964034 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b386b77e-6b78-4463-b9cb-a225de3aa809 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:22.971859 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b386b77e-6b78-4463-b9cb-a225de3aa809 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:22.972549 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b386b77e-6b78-4463-b9cb-a225de3aa809 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:22.974896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b386b77e-6b78-4463-b9cb-a225de3aa809 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:22.974896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b386b77e-6b78-4463-b9cb-a225de3aa809 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:23.010688 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b386b77e-6b78-4463-b9cb-a225de3aa809 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Going to try to terminate instance {{(pid=118306) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:28:23.131795 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5efa3890-410a-45b1-b286-0b8555062d60 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:23.132498 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5efa3890-410a-45b1-b286-0b8555062d60 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:23.146163 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5efa3890-410a-45b1-b286-0b8555062d60 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:23.146696 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5efa3890-410a-45b1-b286-0b8555062d60 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:23.147561 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5efa3890-410a-45b1-b286-0b8555062d60 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:23.148063 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5efa3890-410a-45b1-b286-0b8555062d60 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:23.267789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b386b77e-6b78-4463-b9cb-a225de3aa809 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 204 len: 0 microversion: 2.1 time: 0.307983 May 26 20:28:23.268922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 256/506] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:28:22 2022] DELETE /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:28:23.287554 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2c8ac9e3-d55e-4389-8cee-38026709c3ae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:23.288262 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2c8ac9e3-d55e-4389-8cee-38026709c3ae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:23.295083 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2c8ac9e3-d55e-4389-8cee-38026709c3ae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:23.295531 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2c8ac9e3-d55e-4389-8cee-38026709c3ae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:23.296309 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2c8ac9e3-d55e-4389-8cee-38026709c3ae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:23.296743 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2c8ac9e3-d55e-4389-8cee-38026709c3ae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:23.305019 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5efa3890-410a-45b1-b286-0b8555062d60 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:23.313177 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5efa3890-410a-45b1-b286-0b8555062d60 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.185468 May 26 20:28:23.313693 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 251/507] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:23 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:28:23.428434 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2c8ac9e3-d55e-4389-8cee-38026709c3ae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:23.437001 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2c8ac9e3-d55e-4389-8cee-38026709c3ae tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1672 microversion: 2.1 time: 0.153913 May 26 20:28:23.437573 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 257/508] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:23 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:24.329922 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-38909111-a8a6-4d8d-a65b-83401b9b642e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:24.330554 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-38909111-a8a6-4d8d-a65b-83401b9b642e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:24.336955 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-38909111-a8a6-4d8d-a65b-83401b9b642e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:24.337398 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-38909111-a8a6-4d8d-a65b-83401b9b642e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:24.338153 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-38909111-a8a6-4d8d-a65b-83401b9b642e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:24.338681 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-38909111-a8a6-4d8d-a65b-83401b9b642e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:24.454988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2e80ee74-d32a-44e6-bfb9-8c4a57b17418 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:24.455793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2e80ee74-d32a-44e6-bfb9-8c4a57b17418 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:24.462564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2e80ee74-d32a-44e6-bfb9-8c4a57b17418 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:24.463011 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2e80ee74-d32a-44e6-bfb9-8c4a57b17418 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:24.466411 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2e80ee74-d32a-44e6-bfb9-8c4a57b17418 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:24.466411 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2e80ee74-d32a-44e6-bfb9-8c4a57b17418 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:24.470840 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-38909111-a8a6-4d8d-a65b-83401b9b642e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:24.478347 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-38909111-a8a6-4d8d-a65b-83401b9b642e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.152390 May 26 20:28:24.479149 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 252/509] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:24 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:24.646511 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2e80ee74-d32a-44e6-bfb9-8c4a57b17418 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:24.654989 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2e80ee74-d32a-44e6-bfb9-8c4a57b17418 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1672 microversion: 2.1 time: 0.204777 May 26 20:28:24.655576 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 258/510] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:24 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1672 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:28:25.496206 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-304a94f9-9278-4ebd-b7a3-3894f9876db2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:25.497947 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-304a94f9-9278-4ebd-b7a3-3894f9876db2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:25.505212 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-304a94f9-9278-4ebd-b7a3-3894f9876db2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:25.505747 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-304a94f9-9278-4ebd-b7a3-3894f9876db2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:25.506784 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-304a94f9-9278-4ebd-b7a3-3894f9876db2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:25.507300 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-304a94f9-9278-4ebd-b7a3-3894f9876db2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:25.672212 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5c4911a2-cbf0-48eb-b396-026d38c5cf10 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:25.674704 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5c4911a2-cbf0-48eb-b396-026d38c5cf10 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:25.675838 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:25.680981 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5c4911a2-cbf0-48eb-b396-026d38c5cf10 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:25.681502 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5c4911a2-cbf0-48eb-b396-026d38c5cf10 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:25.682509 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5c4911a2-cbf0-48eb-b396-026d38c5cf10 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:25.683168 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5c4911a2-cbf0-48eb-b396-026d38c5cf10 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:25.775358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-304a94f9-9278-4ebd-b7a3-3894f9876db2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:25.787626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-304a94f9-9278-4ebd-b7a3-3894f9876db2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.295724 May 26 20:28:25.788458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 253/511] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:25 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:25.851508 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5c4911a2-cbf0-48eb-b396-026d38c5cf10 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:25.860167 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5c4911a2-cbf0-48eb-b396-026d38c5cf10 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1672 microversion: 2.1 time: 0.192915 May 26 20:28:25.860768 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 259/512] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:25 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:28:25.990811 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1d50390d-b147-4f5e-b019-f74204af7a9d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:25.991301 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1d50390d-b147-4f5e-b019-f74204af7a9d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:25.997389 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d50390d-b147-4f5e-b019-f74204af7a9d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:25.997837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d50390d-b147-4f5e-b019-f74204af7a9d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:25.998644 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d50390d-b147-4f5e-b019-f74204af7a9d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:25.999082 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d50390d-b147-4f5e-b019-f74204af7a9d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:26.082976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-1d50390d-b147-4f5e-b019-f74204af7a9d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lazy-loading 'services' on Instance uuid 6602854b-bca1-47cb-9307-9e01ce9e96d7 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:28:26.273529 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1d50390d-b147-4f5e-b019-f74204af7a9d tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments/bbb26693-7525-40c6-9fab-b92ad7ba86b8" status: 202 len: 0 microversion: 2.1 time: 0.286856 May 26 20:28:26.274045 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 254/513] 10.222.0.44 () {58 vars in 1415 bytes} [Thu May 26 20:28:25 2022] DELETE /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments/bbb26693-7525-40c6-9fab-b92ad7ba86b8 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:28:26.283897 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1c787078-ca03-4b5e-aa26-042f2ec4392a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:26.284901 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-1c787078-ca03-4b5e-aa26-042f2ec4392a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:26.292082 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1c787078-ca03-4b5e-aa26-042f2ec4392a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:26.292588 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1c787078-ca03-4b5e-aa26-042f2ec4392a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:26.293612 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1c787078-ca03-4b5e-aa26-042f2ec4392a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:26.294770 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1c787078-ca03-4b5e-aa26-042f2ec4392a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:26.320751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:26.333626 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1c787078-ca03-4b5e-aa26-042f2ec4392a tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054266 May 26 20:28:26.336291 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 260/514] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:28:26 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:26.441217 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-45621ccc-e893-4fdc-96cd-2ee84ae688be req-9ffcb1b8-aaa2-4fab-98a2-7e7e2ccb75c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f", "name": "network-vif-deleted", "tag": "ed56f181-3869-4093-b872-aca46d220d93"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:26.450958 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-45621ccc-e893-4fdc-96cd-2ee84ae688be req-9ffcb1b8-aaa2-4fab-98a2-7e7e2ccb75c1 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:26.451485 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-45621ccc-e893-4fdc-96cd-2ee84ae688be req-9ffcb1b8-aaa2-4fab-98a2-7e7e2ccb75c1 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:26.463834 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-45621ccc-e893-4fdc-96cd-2ee84ae688be req-9ffcb1b8-aaa2-4fab-98a2-7e7e2ccb75c1 service nova] Creating event network-vif-deleted:ed56f181-3869-4093-b872-aca46d220d93 for instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f on hv-cinder-84213 May 26 20:28:26.469966 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-45621ccc-e893-4fdc-96cd-2ee84ae688be req-9ffcb1b8-aaa2-4fab-98a2-7e7e2ccb75c1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032905 May 26 20:28:26.471034 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 255/515] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:26.807003 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-16c0ccd0-c936-4fba-a043-10a8aa957340 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:26.807619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-16c0ccd0-c936-4fba-a043-10a8aa957340 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:26.819388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-16c0ccd0-c936-4fba-a043-10a8aa957340 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:26.819901 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-16c0ccd0-c936-4fba-a043-10a8aa957340 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:26.820719 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-16c0ccd0-c936-4fba-a043-10a8aa957340 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:26.821167 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-16c0ccd0-c936-4fba-a043-10a8aa957340 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:26.880608 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-abc22bdd-9277-49d8-b099-e241d28f6ad3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:26.881923 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-abc22bdd-9277-49d8-b099-e241d28f6ad3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:26.889657 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abc22bdd-9277-49d8-b099-e241d28f6ad3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:26.890110 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abc22bdd-9277-49d8-b099-e241d28f6ad3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:26.891191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abc22bdd-9277-49d8-b099-e241d28f6ad3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:26.891549 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-abc22bdd-9277-49d8-b099-e241d28f6ad3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:26.975416 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-abc22bdd-9277-49d8-b099-e241d28f6ad3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:26.984686 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-abc22bdd-9277-49d8-b099-e241d28f6ad3 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 200 len: 1320 microversion: 2.1 time: 0.109164 May 26 20:28:26.985365 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 256/516] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:26 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 1320 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:27.046568 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-16c0ccd0-c936-4fba-a043-10a8aa957340 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:27.054271 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-16c0ccd0-c936-4fba-a043-10a8aa957340 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.251471 May 26 20:28:27.054883 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 261/517] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:26 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:27.346414 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-06270364-051e-46c1-a691-9cd0a6085173 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:27.347517 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-06270364-051e-46c1-a691-9cd0a6085173 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:27.353634 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-06270364-051e-46c1-a691-9cd0a6085173 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:27.354093 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-06270364-051e-46c1-a691-9cd0a6085173 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:27.355384 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-06270364-051e-46c1-a691-9cd0a6085173 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:27.355384 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-06270364-051e-46c1-a691-9cd0a6085173 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:27.359870 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:27.387619 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-06270364-051e-46c1-a691-9cd0a6085173 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045068 May 26 20:28:27.390437 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 257/518] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:28:27 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:28.016007 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cac70277-923b-4d60-8056-2ff138450844 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:28.016635 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-cac70277-923b-4d60-8056-2ff138450844 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:28.034013 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cac70277-923b-4d60-8056-2ff138450844 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:28.035119 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cac70277-923b-4d60-8056-2ff138450844 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:28.037658 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cac70277-923b-4d60-8056-2ff138450844 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:28.037658 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cac70277-923b-4d60-8056-2ff138450844 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:28.058572 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-cac70277-923b-4d60-8056-2ff138450844 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] HTTP exception thrown: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cac70277-923b-4d60-8056-2ff138450844 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Request method failure captured: May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f HTTP/1.1 May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-HHgWoY06vmFkOlQs2T9nnABRYdwtUiwO68G1UB-MdamE4DxSLlm9O0B7P2XdiKZfaOvA51ORcm2WFaKgu7kkt4xTzFlRZCJ9MrEtQEeXqRdEk2hfzGfKgVnVoefk5nvAsfpCu_6Bsly54_Zi9ednQJhAGMWUYS19tEbCOwSLpaDhQ May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: 414b3aedf5e947d39018df71b2f106ba May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-AttachVolumeTestJSON-501724308 May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:28:28.061317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:28:28.062978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:28:28.062978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-AttachVolumeTestJSON-501724308 May 26 20:28:28.062978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: 414b3aedf5e947d39018df71b2f106ba May 26 20:28:28.062978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-AttachVolumeTestJSON-501724308 May 26 20:28:28.062978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-AttachVolumeTestJSON-501724308-project May 26 20:28:28.062978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:28:28.062978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:28:28.062978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: d35a55bcc5754bf88adbd343ab8116d2 May 26 20:28:28.062978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-AttachVolumeTestJSON-501724308-project May 26 20:28:28.062978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:28:28.062978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:28:28.062978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f'} May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:28:28.063856 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:28:28.065388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:28:28.066708 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cac70277-923b-4d60-8056-2ff138450844 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Returning 404 to user: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:28:28.066708 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-cac70277-923b-4d60-8056-2ff138450844 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 404 len: 111 microversion: 2.1 time: 0.063619 May 26 20:28:28.066708 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 262/519] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:27 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:28:28.072921 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-90548d42-6b88-49ad-8985-9bfa1ca13098 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '.version_select at 0x7f2da453cf70>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:28.073489 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-70ba2f5d-be4b-4d06-83c7-3b3302b87cff tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:28.074016 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-70ba2f5d-be4b-4d06-83c7-3b3302b87cff tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:28.082980 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-70ba2f5d-be4b-4d06-83c7-3b3302b87cff tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:28.083694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-70ba2f5d-be4b-4d06-83c7-3b3302b87cff tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:28.084376 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-70ba2f5d-be4b-4d06-83c7-3b3302b87cff tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:28.084903 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-70ba2f5d-be4b-4d06-83c7-3b3302b87cff tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:28.155628 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-90548d42-6b88-49ad-8985-9bfa1ca13098 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-681453825" status: 202 len: 0 microversion: 2.1 time: 0.086315 May 26 20:28:28.160752 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 263/520] 10.222.0.44 () {58 vars in 1217 bytes} [Thu May 26 20:28:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-681453825 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:28:28.255484 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-70ba2f5d-be4b-4d06-83c7-3b3302b87cff tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:28.265053 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-70ba2f5d-be4b-4d06-83c7-3b3302b87cff tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.195844 May 26 20:28:28.266396 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 258/521] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:28 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:28:28.400795 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-75ccb508-39a0-4a3e-a81a-b050f2e90a0c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:28.402063 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-75ccb508-39a0-4a3e-a81a-b050f2e90a0c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:28.410792 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75ccb508-39a0-4a3e-a81a-b050f2e90a0c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:28.411247 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75ccb508-39a0-4a3e-a81a-b050f2e90a0c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:28.412050 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75ccb508-39a0-4a3e-a81a-b050f2e90a0c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:28.412663 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75ccb508-39a0-4a3e-a81a-b050f2e90a0c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:28.462462 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-75ccb508-39a0-4a3e-a81a-b050f2e90a0c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066386 May 26 20:28:28.463097 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 264/522] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:28:28 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 20:28:28.555475 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-43782258-a7b0-489a-aa2b-70afc45cafa1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:28.555966 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-43782258-a7b0-489a-aa2b-70afc45cafa1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:28.558136 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:28.564005 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43782258-a7b0-489a-aa2b-70afc45cafa1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:28.564455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43782258-a7b0-489a-aa2b-70afc45cafa1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:28.565231 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43782258-a7b0-489a-aa2b-70afc45cafa1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:28.565667 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43782258-a7b0-489a-aa2b-70afc45cafa1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:28.598077 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-43782258-a7b0-489a-aa2b-70afc45cafa1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:28:28.917649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-43782258-a7b0-489a-aa2b-70afc45cafa1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 204 len: 0 microversion: 2.1 time: 0.364904 May 26 20:28:28.919750 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 259/523] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:28:28 2022] DELETE /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:28:28.928507 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c06cf291-7427-4d3c-9b31-1a2138c19d37 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:28.929357 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c06cf291-7427-4d3c-9b31-1a2138c19d37 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:28.936044 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c06cf291-7427-4d3c-9b31-1a2138c19d37 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:28.936470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c06cf291-7427-4d3c-9b31-1a2138c19d37 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:28.937522 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c06cf291-7427-4d3c-9b31-1a2138c19d37 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:28.938060 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c06cf291-7427-4d3c-9b31-1a2138c19d37 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:29.030783 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-9cc2c714-95fa-40dd-91da-607fcad6489a req-74a5944f-f65e-43a3-8fd5-3b5637bd5afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6f1ba5-371c-4465-8534-2eb1ef60acdb", "name": "network-vif-plugged", "status": "completed", "tag": "a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:29.039984 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-9cc2c714-95fa-40dd-91da-607fcad6489a req-74a5944f-f65e-43a3-8fd5-3b5637bd5afa service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:29.040445 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-9cc2c714-95fa-40dd-91da-607fcad6489a req-74a5944f-f65e-43a3-8fd5-3b5637bd5afa service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:29.051659 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-9cc2c714-95fa-40dd-91da-607fcad6489a req-74a5944f-f65e-43a3-8fd5-3b5637bd5afa service nova] Creating event network-vif-plugged:a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d for instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb on hv-cinder-84213 May 26 20:28:29.056742 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-9cc2c714-95fa-40dd-91da-607fcad6489a req-74a5944f-f65e-43a3-8fd5-3b5637bd5afa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030852 May 26 20:28:29.057336 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 260/524] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:28:29.284560 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0eff2d4b-3818-4753-ac1d-4cba9af20939 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:29.285269 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0eff2d4b-3818-4753-ac1d-4cba9af20939 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:29.292068 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0eff2d4b-3818-4753-ac1d-4cba9af20939 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:29.292523 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0eff2d4b-3818-4753-ac1d-4cba9af20939 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:29.293301 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0eff2d4b-3818-4753-ac1d-4cba9af20939 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:29.293780 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0eff2d4b-3818-4753-ac1d-4cba9af20939 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:29.297330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c06cf291-7427-4d3c-9b31-1a2138c19d37 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:29.306355 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c06cf291-7427-4d3c-9b31-1a2138c19d37 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1688 microversion: 2.1 time: 0.382404 May 26 20:28:29.307322 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 265/525] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:28 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1688 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:29.458636 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-0eff2d4b-3818-4753-ac1d-4cba9af20939 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:29.467833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0eff2d4b-3818-4753-ac1d-4cba9af20939 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.187773 May 26 20:28:29.477289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 261/526] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:29 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:29.817222 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-aaa4eadb-a060-463a-8ec3-1ac8d8538a94 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Action: 'create', calling method: .version_select at 0x7f2da453cdc0>, body: {"keypair": {"name": "tempest-keypair-1698798515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/sP4gb6XZIeLRHFBazoOA75Wj8M/+apAXhTlSTMABz0+aYL3J+T4ltGOjtfQwpu6hNki/NYrFaClAeuEzMF4DjwmZd4rGMSx0InnutJQ1F9bYVlM34Kk1ZGmhPsKfQBw=="}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:29.839844 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-aaa4eadb-a060-463a-8ec3-1ac8d8538a94 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Getting quotas for project 414b3aedf5e947d39018df71b2f106ba. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:28:29.845970 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-aaa4eadb-a060-463a-8ec3-1ac8d8538a94 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Getting quotas for user d35a55bcc5754bf88adbd343ab8116d2 and project 414b3aedf5e947d39018df71b2f106ba. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:28:29.930300 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-aaa4eadb-a060-463a-8ec3-1ac8d8538a94 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117080 May 26 20:28:29.930906 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 266/527] 10.222.0.44 () {60 vars in 1158 bytes} [Thu May 26 20:28:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:30.327968 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0650b5eb-a5b2-48b0-b360-f333c24459b6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:30.328670 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0650b5eb-a5b2-48b0-b360-f333c24459b6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:30.336389 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0650b5eb-a5b2-48b0-b360-f333c24459b6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:30.337101 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0650b5eb-a5b2-48b0-b360-f333c24459b6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:30.338412 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0650b5eb-a5b2-48b0-b360-f333c24459b6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:30.338926 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0650b5eb-a5b2-48b0-b360-f333c24459b6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:30.488126 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7de5a861-cf5f-4746-8885-cd28ab0509a0 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:30.489477 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7de5a861-cf5f-4746-8885-cd28ab0509a0 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:30.500599 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7de5a861-cf5f-4746-8885-cd28ab0509a0 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:30.501385 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7de5a861-cf5f-4746-8885-cd28ab0509a0 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:30.502403 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7de5a861-cf5f-4746-8885-cd28ab0509a0 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:30.503475 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7de5a861-cf5f-4746-8885-cd28ab0509a0 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:30.700998 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-0650b5eb-a5b2-48b0-b360-f333c24459b6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:30.708904 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0650b5eb-a5b2-48b0-b360-f333c24459b6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1688 microversion: 2.1 time: 0.388288 May 26 20:28:30.709851 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 262/528] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:30 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1688 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:30.881816 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7de5a861-cf5f-4746-8885-cd28ab0509a0 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:30.890834 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7de5a861-cf5f-4746-8885-cd28ab0509a0 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.410256 May 26 20:28:30.900047 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 267/529] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:30 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:31.734534 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-099a8911-8ea5-4e48-84eb-87f116909ca4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:31.735766 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-099a8911-8ea5-4e48-84eb-87f116909ca4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:31.744222 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-099a8911-8ea5-4e48-84eb-87f116909ca4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:31.744965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-099a8911-8ea5-4e48-84eb-87f116909ca4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:31.745772 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-099a8911-8ea5-4e48-84eb-87f116909ca4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:31.746209 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-099a8911-8ea5-4e48-84eb-87f116909ca4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:31.925269 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-15ad1185-2ce1-49a8-9851-262b6202bfc4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:31.926733 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-15ad1185-2ce1-49a8-9851-262b6202bfc4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:31.936128 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-15ad1185-2ce1-49a8-9851-262b6202bfc4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:31.936862 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-15ad1185-2ce1-49a8-9851-262b6202bfc4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:31.937841 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-15ad1185-2ce1-49a8-9851-262b6202bfc4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:31.938492 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-15ad1185-2ce1-49a8-9851-262b6202bfc4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:31.984059 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-099a8911-8ea5-4e48-84eb-87f116909ca4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:32.005185 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-099a8911-8ea5-4e48-84eb-87f116909ca4 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1688 microversion: 2.1 time: 0.280513 May 26 20:28:32.006512 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 263/530] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:31 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1688 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:32.231164 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-15ad1185-2ce1-49a8-9851-262b6202bfc4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:32.252157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-15ad1185-2ce1-49a8-9851-262b6202bfc4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.345016 May 26 20:28:32.261797 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 268/531] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:31 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:33.023174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-012c80d8-b39c-4efe-b84d-24a8aa88cabf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:33.023802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-012c80d8-b39c-4efe-b84d-24a8aa88cabf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:33.031170 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-012c80d8-b39c-4efe-b84d-24a8aa88cabf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:33.031630 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-012c80d8-b39c-4efe-b84d-24a8aa88cabf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:33.032424 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-012c80d8-b39c-4efe-b84d-24a8aa88cabf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:33.032867 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-012c80d8-b39c-4efe-b84d-24a8aa88cabf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:33.269118 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-336f112b-db63-4cce-bbd0-025874297222 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:33.269896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-336f112b-db63-4cce-bbd0-025874297222 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:33.277235 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-336f112b-db63-4cce-bbd0-025874297222 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:33.278200 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-336f112b-db63-4cce-bbd0-025874297222 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:33.278977 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-336f112b-db63-4cce-bbd0-025874297222 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:33.279402 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-336f112b-db63-4cce-bbd0-025874297222 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:33.375440 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-012c80d8-b39c-4efe-b84d-24a8aa88cabf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:33.391112 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-012c80d8-b39c-4efe-b84d-24a8aa88cabf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1688 microversion: 2.1 time: 0.371869 May 26 20:28:33.400777 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 264/532] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:33 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1688 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:33.512755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-336f112b-db63-4cce-bbd0-025874297222 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:33.521152 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-336f112b-db63-4cce-bbd0-025874297222 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1357 microversion: 2.1 time: 0.256043 May 26 20:28:33.521742 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 269/533] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:33 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1357 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:33.562661 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-319692187", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "781b6e2a-0fd2-490f-8060-5db4b6f9e2c7"}], "security_groups": [{"name": "tempest-securitygroup--1820581015"}], "key_name": "tempest-keypair-1698798515", "user_data": "}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:33.732492 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] validate_networks() for [('781b6e2a-0fd2-490f-8060-5db4b6f9e2c7', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:28:34.237033 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-0dc89f72-351c-46e5-9ec7-59ea66ba0ef7 req-5d2f8f16-e44d-4e30-a3c8-8ce9c988baf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6602854b-bca1-47cb-9307-9e01ce9e96d7", "name": "network-vif-deleted", "tag": "fc329004-fdd7-4ee6-a7be-33d3addac5bc"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:34.261512 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-0dc89f72-351c-46e5-9ec7-59ea66ba0ef7 req-5d2f8f16-e44d-4e30-a3c8-8ce9c988baf4 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:34.261512 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-0dc89f72-351c-46e5-9ec7-59ea66ba0ef7 req-5d2f8f16-e44d-4e30-a3c8-8ce9c988baf4 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:34.285275 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-0dc89f72-351c-46e5-9ec7-59ea66ba0ef7 req-5d2f8f16-e44d-4e30-a3c8-8ce9c988baf4 service nova] Creating event network-vif-deleted:fc329004-fdd7-4ee6-a7be-33d3addac5bc for instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 on hv-cinder-84213 May 26 20:28:34.298903 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-0dc89f72-351c-46e5-9ec7-59ea66ba0ef7 req-5d2f8f16-e44d-4e30-a3c8-8ce9c988baf4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067760 May 26 20:28:34.299870 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 270/534] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:28:34.416367 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-39703b5d-e60d-441e-ac7b-e3fc120f0a2c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:34.417274 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-39703b5d-e60d-441e-ac7b-e3fc120f0a2c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:34.436756 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-39703b5d-e60d-441e-ac7b-e3fc120f0a2c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:34.456349 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-39703b5d-e60d-441e-ac7b-e3fc120f0a2c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:34.457608 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-39703b5d-e60d-441e-ac7b-e3fc120f0a2c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:34.458164 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-39703b5d-e60d-441e-ac7b-e3fc120f0a2c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:34.495290 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:28:34.495810 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:28:34.498375 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:28:34.499079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:28:34.499758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:28:34.524175 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:34.528194 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:34.529257 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:34.529705 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:34.567819 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Getting quotas for project 414b3aedf5e947d39018df71b2f106ba. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:28:34.572930 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Getting quotas for user d35a55bcc5754bf88adbd343ab8116d2 and project 414b3aedf5e947d39018df71b2f106ba. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:28:34.586281 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:28:34.588935 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:28:34.644656 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-39703b5d-e60d-441e-ac7b-e3fc120f0a2c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:34.654774 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-39703b5d-e60d-441e-ac7b-e3fc120f0a2c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 200 len: 1330 microversion: 2.1 time: 0.247905 May 26 20:28:34.655731 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 271/535] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:34 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 1330 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:34.662567 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-dc66f2c1-8702-4067-bf9d-e6d5c31b3a92 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:34.663597 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-dc66f2c1-8702-4067-bf9d-e6d5c31b3a92 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:34.681359 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dc66f2c1-8702-4067-bf9d-e6d5c31b3a92 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:34.682498 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dc66f2c1-8702-4067-bf9d-e6d5c31b3a92 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:34.683459 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dc66f2c1-8702-4067-bf9d-e6d5c31b3a92 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:34.683911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dc66f2c1-8702-4067-bf9d-e6d5c31b3a92 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:34.768834 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-16417d7a-5ccb-44be-b048-59988c120232 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.210835 May 26 20:28:34.777411 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 265/536] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:28:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:28:34.783956 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-20825a32-39ed-4782-a9a8-bea03401bcd8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:34.784050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-20825a32-39ed-4782-a9a8-bea03401bcd8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:34.941526 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-dc66f2c1-8702-4067-bf9d-e6d5c31b3a92 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:34.953884 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-dc66f2c1-8702-4067-bf9d-e6d5c31b3a92 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1547 microversion: 2.1 time: 0.296802 May 26 20:28:34.954422 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 272/537] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:34 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1547 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:34.973111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5b797c94-668e-4b01-aa35-f5723ef074b6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:34.974085 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5b797c94-668e-4b01-aa35-f5723ef074b6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:34.982913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5b797c94-668e-4b01-aa35-f5723ef074b6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:34.984654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5b797c94-668e-4b01-aa35-f5723ef074b6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:34.985435 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5b797c94-668e-4b01-aa35-f5723ef074b6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:34.985869 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5b797c94-668e-4b01-aa35-f5723ef074b6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:35.112087 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-20825a32-39ed-4782-a9a8-bea03401bcd8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:35.123638 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-20825a32-39ed-4782-a9a8-bea03401bcd8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1237 microversion: 2.1 time: 0.344335 May 26 20:28:35.126019 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 266/538] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:34 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1237 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:35.165165 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5b797c94-668e-4b01-aa35-f5723ef074b6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:35.173687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5b797c94-668e-4b01-aa35-f5723ef074b6 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1547 microversion: 2.1 time: 0.206112 May 26 20:28:35.174297 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 273/539] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:34 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1547 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:28:35.192501 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-605fafcf-3655-4387-b6f0-b5dedefe909b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:35.197180 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-605fafcf-3655-4387-b6f0-b5dedefe909b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:35.198566 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-605fafcf-3655-4387-b6f0-b5dedefe909b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Searching by: {'deleted': False, 'project_id': '437e2c484c1d4accb95b3787fd921363'} {{(pid=118307) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 20:28:35.211270 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-605fafcf-3655-4387-b6f0-b5dedefe909b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:35.211961 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-605fafcf-3655-4387-b6f0-b5dedefe909b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:35.213192 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-605fafcf-3655-4387-b6f0-b5dedefe909b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:35.213835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-605fafcf-3655-4387-b6f0-b5dedefe909b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:35.320073 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.multi_cell_list [None req-605fafcf-3655-4387-b6f0-b5dedefe909b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118307) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 20:28:35.449065 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-605fafcf-3655-4387-b6f0-b5dedefe909b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.262646 May 26 20:28:35.451242 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 267/540] 10.222.0.44 () {58 vars in 1124 bytes} [Thu May 26 20:28:35 2022] GET /compute/v2.1/servers => generated 342 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:35.462171 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-24927a95-27ee-4a6c-b71f-8c5ddaaa9591 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:35.463514 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-24927a95-27ee-4a6c-b71f-8c5ddaaa9591 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:35.474866 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24927a95-27ee-4a6c-b71f-8c5ddaaa9591 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:35.478140 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24927a95-27ee-4a6c-b71f-8c5ddaaa9591 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:35.478140 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24927a95-27ee-4a6c-b71f-8c5ddaaa9591 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:35.478140 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24927a95-27ee-4a6c-b71f-8c5ddaaa9591 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:35.674492 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1228716c-461e-41a9-95cb-712e8d632fc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:35.675666 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1228716c-461e-41a9-95cb-712e8d632fc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 6602854b-bca1-47cb-9307-9e01ce9e96d7] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:35.682531 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1228716c-461e-41a9-95cb-712e8d632fc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:35.684070 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1228716c-461e-41a9-95cb-712e8d632fc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:35.685421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1228716c-461e-41a9-95cb-712e8d632fc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:35.686069 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1228716c-461e-41a9-95cb-712e8d632fc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:35.718019 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-1228716c-461e-41a9-95cb-712e8d632fc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] HTTP exception thrown: Instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 could not be found. May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1228716c-461e-41a9-95cb-712e8d632fc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Request method failure captured: May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 HTTP/1.1 May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HMctYnQef_fAFPqfLUdEsnXRp3PwFjMEZRaQa7XPlJWn0X3l7DHadWcb2y0MoBJ1Hg8jC9EJQtLjfc-f0GM-q2csWz-teo7cHIAXDxZzA1vXKbu_xP23ZMRI-6Dd4cd3BeN3sMIbgVw_F3vNl2TJ_XqOLmKvEG7iH0NVNfQM8lyCE May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: f6160118ba95403e8df08ac74982954d May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:28:35.721436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:28:35.723039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f6160118ba95403e8df08ac74982954d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6160118ba95403e8df08ac74982954d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f6160118ba95403e8df08ac74982954d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6160118ba95403e8df08ac74982954d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:28:35.723039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:28:35.723039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: f6160118ba95403e8df08ac74982954d May 26 20:28:35.723039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:28:35.723039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-ServerRescueNegativeTestJSON-1606344399-project May 26 20:28:35.723039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:28:35.723039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:28:35.723039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 146a7d1f40854f859864d463f403178f May 26 20:28:35.723039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606344399-project May 26 20:28:35.723039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:28:35.723039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 could not be found. May 26 20:28:35.723039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '6602854b-bca1-47cb-9307-9e01ce9e96d7'} May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 could not be found. May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:28:35.723910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 could not be found. May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 could not be found. May 26 20:28:35.725253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:35.731926 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1228716c-461e-41a9-95cb-712e8d632fc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Returning 404 to user: Instance 6602854b-bca1-47cb-9307-9e01ce9e96d7 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:28:35.733577 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1228716c-461e-41a9-95cb-712e8d632fc7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7" status: 404 len: 111 microversion: 2.1 time: 0.062340 May 26 20:28:35.734155 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 268/541] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:35 2022] GET /compute/v2.1/servers/6602854b-bca1-47cb-9307-9e01ce9e96d7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:28:35.742916 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b32bf4e2-20fb-431f-adff-e9a27d7a6a6f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '.version_select at 0x7f2da454b790>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:35.758749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-24927a95-27ee-4a6c-b71f-8c5ddaaa9591 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:35.766626 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-24927a95-27ee-4a6c-b71f-8c5ddaaa9591 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1547 microversion: 2.1 time: 0.309191 May 26 20:28:35.770200 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 274/542] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:35 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1547 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:35.915285 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b32bf4e2-20fb-431f-adff-e9a27d7a6a6f tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089628749" status: 202 len: 0 microversion: 2.1 time: 0.176461 May 26 20:28:35.919349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 269/543] 10.222.0.44 () {58 vars in 1220 bytes} [Thu May 26 20:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089628749 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:28:36.143045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-fae1f5f2-6197-4ef3-822d-61560db17b79 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:36.143998 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-fae1f5f2-6197-4ef3-822d-61560db17b79 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:36.159528 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fae1f5f2-6197-4ef3-822d-61560db17b79 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:36.162553 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fae1f5f2-6197-4ef3-822d-61560db17b79 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:36.167576 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fae1f5f2-6197-4ef3-822d-61560db17b79 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:36.168439 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fae1f5f2-6197-4ef3-822d-61560db17b79 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:36.368541 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-fae1f5f2-6197-4ef3-822d-61560db17b79 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:36.383077 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-fae1f5f2-6197-4ef3-822d-61560db17b79 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1241 microversion: 2.1 time: 0.245942 May 26 20:28:36.386944 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 275/544] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:36 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1241 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:37.406222 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c2440210-4616-4a1c-a0be-f19a1143ecc8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:37.407463 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c2440210-4616-4a1c-a0be-f19a1143ecc8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:37.427157 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c2440210-4616-4a1c-a0be-f19a1143ecc8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:37.429834 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c2440210-4616-4a1c-a0be-f19a1143ecc8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:37.442734 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c2440210-4616-4a1c-a0be-f19a1143ecc8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:37.447490 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c2440210-4616-4a1c-a0be-f19a1143ecc8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:37.552233 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c2440210-4616-4a1c-a0be-f19a1143ecc8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:37.564432 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c2440210-4616-4a1c-a0be-f19a1143ecc8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1289 microversion: 2.1 time: 0.163250 May 26 20:28:37.565282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 270/545] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:37 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1289 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:38.128847 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ce5eef1a-0fbb-4637-be1f-6cad86940eb2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0454e8ac-031a-4836-b540-e9c22c6130e1"}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:38.131010 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ce5eef1a-0fbb-4637-be1f-6cad86940eb2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:38.167227 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ce5eef1a-0fbb-4637-be1f-6cad86940eb2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:38.174065 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ce5eef1a-0fbb-4637-be1f-6cad86940eb2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:38.179634 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ce5eef1a-0fbb-4637-be1f-6cad86940eb2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:38.179634 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ce5eef1a-0fbb-4637-be1f-6cad86940eb2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:38.585696 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8cafbbcc-99bd-45ef-8111-b216ccf647ff tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:38.586592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8cafbbcc-99bd-45ef-8111-b216ccf647ff tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:38.595661 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cafbbcc-99bd-45ef-8111-b216ccf647ff tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:38.596233 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cafbbcc-99bd-45ef-8111-b216ccf647ff tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:38.597957 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cafbbcc-99bd-45ef-8111-b216ccf647ff tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:38.598469 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8cafbbcc-99bd-45ef-8111-b216ccf647ff tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:38.759871 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-8cafbbcc-99bd-45ef-8111-b216ccf647ff tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:38.769715 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8cafbbcc-99bd-45ef-8111-b216ccf647ff tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1295 microversion: 2.1 time: 0.190424 May 26 20:28:38.781012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 271/546] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:38 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1295 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:39.145758 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ce5eef1a-0fbb-4637-be1f-6cad86940eb2 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "POST /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.021994 May 26 20:28:39.152054 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 276/547] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:28:38 2022] POST /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments => generated 194 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:39.788020 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e81c23cd-2fc8-4bc9-872a-95ee65a79c0a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:39.788803 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e81c23cd-2fc8-4bc9-872a-95ee65a79c0a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:39.796433 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e81c23cd-2fc8-4bc9-872a-95ee65a79c0a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:39.797188 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e81c23cd-2fc8-4bc9-872a-95ee65a79c0a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:39.798090 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e81c23cd-2fc8-4bc9-872a-95ee65a79c0a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:39.798647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e81c23cd-2fc8-4bc9-872a-95ee65a79c0a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:40.312099 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-353eee9a-ce32-494b-ba8b-46afb8be8294 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:40.313689 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-353eee9a-ce32-494b-ba8b-46afb8be8294 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:40.320783 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=4 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:40.323968 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-353eee9a-ce32-494b-ba8b-46afb8be8294 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:40.328444 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-353eee9a-ce32-494b-ba8b-46afb8be8294 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:40.328444 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-353eee9a-ce32-494b-ba8b-46afb8be8294 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:40.328444 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-353eee9a-ce32-494b-ba8b-46afb8be8294 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:40.353124 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e81c23cd-2fc8-4bc9-872a-95ee65a79c0a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:40.357072 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-353eee9a-ce32-494b-ba8b-46afb8be8294 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Going to try to terminate instance {{(pid=118306) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:28:40.372355 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e81c23cd-2fc8-4bc9-872a-95ee65a79c0a tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1363 microversion: 2.1 time: 0.588145 May 26 20:28:40.374607 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 272/548] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:39 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1363 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:40.534138 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:40.708752 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-353eee9a-ce32-494b-ba8b-46afb8be8294 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "DELETE /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 204 len: 0 microversion: 2.1 time: 0.403403 May 26 20:28:40.709575 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 277/549] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:28:40 2022] DELETE /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 20:28:40.721803 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-515e6452-9b5a-46bd-95ce-27261c6aeef1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:40.722651 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-515e6452-9b5a-46bd-95ce-27261c6aeef1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:40.729109 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-515e6452-9b5a-46bd-95ce-27261c6aeef1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:40.729573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-515e6452-9b5a-46bd-95ce-27261c6aeef1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:40.730590 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-515e6452-9b5a-46bd-95ce-27261c6aeef1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:40.732060 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-515e6452-9b5a-46bd-95ce-27261c6aeef1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:41.062231 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-515e6452-9b5a-46bd-95ce-27261c6aeef1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:41.069840 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-515e6452-9b5a-46bd-95ce-27261c6aeef1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1507 microversion: 2.1 time: 0.355218 May 26 20:28:41.070800 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 273/550] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:40 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:41.343331 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-27f1b535-3c10-49ac-acbd-780516031c1d req-84ff4500-5edd-471b-99ce-6be898a249d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0bd3fb-4338-41a5-84ab-d70795eeb59e", "tag": "9bd4765f-7998-4f04-8160-2f7cf452abe1"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:41.369164 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-27f1b535-3c10-49ac-acbd-780516031c1d req-84ff4500-5edd-471b-99ce-6be898a249d3 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:41.369615 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-27f1b535-3c10-49ac-acbd-780516031c1d req-84ff4500-5edd-471b-99ce-6be898a249d3 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:41.396037 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-27f1b535-3c10-49ac-acbd-780516031c1d req-84ff4500-5edd-471b-99ce-6be898a249d3 service nova] Creating event network-changed:9bd4765f-7998-4f04-8160-2f7cf452abe1 for instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e on hv-cinder-84213 May 26 20:28:41.400390 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b33b4ca6-128b-4828-9333-4eadb09d9fea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:41.401126 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b33b4ca6-128b-4828-9333-4eadb09d9fea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:41.405748 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-27f1b535-3c10-49ac-acbd-780516031c1d req-84ff4500-5edd-471b-99ce-6be898a249d3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068356 May 26 20:28:41.406409 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 278/551] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:41.410077 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b33b4ca6-128b-4828-9333-4eadb09d9fea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:41.410964 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b33b4ca6-128b-4828-9333-4eadb09d9fea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:41.412016 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b33b4ca6-128b-4828-9333-4eadb09d9fea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:41.412689 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b33b4ca6-128b-4828-9333-4eadb09d9fea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:41.664578 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b33b4ca6-128b-4828-9333-4eadb09d9fea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:41.673481 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b33b4ca6-128b-4828-9333-4eadb09d9fea tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1363 microversion: 2.1 time: 0.287810 May 26 20:28:41.682840 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 274/552] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:41 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:28:42.089153 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f2f18bd5-2541-4a96-aab7-4378dee9e22c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:42.089828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f2f18bd5-2541-4a96-aab7-4378dee9e22c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:42.096988 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f2f18bd5-2541-4a96-aab7-4378dee9e22c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:42.097471 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f2f18bd5-2541-4a96-aab7-4378dee9e22c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:42.098718 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f2f18bd5-2541-4a96-aab7-4378dee9e22c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:42.099277 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f2f18bd5-2541-4a96-aab7-4378dee9e22c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:42.227479 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-bb219bcf-8c32-4547-8b2b-45ca62a3009d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Action: 'create', calling method: .version_select at 0x7f2da4605430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1889197979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBoD3ju0C5PFU60pGrhxVGdLGXAinE9yw5ZPRxC8Ou0xiPC1mYve6IUSoO0XVDazRe4liQ5QcwehG8CYfmijX9OVXDFg0DX1ZgyVU4r+wl2Xr8oNj2MAC2NZVaXWO/mSA=="}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:42.242750 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-bb219bcf-8c32-4547-8b2b-45ca62a3009d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Getting quotas for project 772b1948bd9546669688fe60a8c9ba46. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:28:42.249195 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f2f18bd5-2541-4a96-aab7-4378dee9e22c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:42.252756 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:42.257626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f2f18bd5-2541-4a96-aab7-4378dee9e22c tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1507 microversion: 2.1 time: 0.173974 May 26 20:28:42.258204 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 275/553] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:42 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:28:42.259776 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-bb219bcf-8c32-4547-8b2b-45ca62a3009d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Getting quotas for user 9558a9c3df27494d990d3b19f560b4d1 and project 772b1948bd9546669688fe60a8c9ba46. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:28:42.372144 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-bb219bcf-8c32-4547-8b2b-45ca62a3009d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.345677 May 26 20:28:42.373714 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 279/554] 10.222.0.44 () {60 vars in 1158 bytes} [Thu May 26 20:28:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:42.691274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-855ff8df-e4f8-4a7e-be7b-94e39490f20b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:42.691931 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-855ff8df-e4f8-4a7e-be7b-94e39490f20b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:42.698975 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-855ff8df-e4f8-4a7e-be7b-94e39490f20b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:42.700034 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-855ff8df-e4f8-4a7e-be7b-94e39490f20b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:42.700892 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-855ff8df-e4f8-4a7e-be7b-94e39490f20b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:42.701344 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-855ff8df-e4f8-4a7e-be7b-94e39490f20b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:42.918081 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-855ff8df-e4f8-4a7e-be7b-94e39490f20b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:42.925732 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-855ff8df-e4f8-4a7e-be7b-94e39490f20b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1363 microversion: 2.1 time: 0.238802 May 26 20:28:42.926331 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 276/555] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:42 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:43.274411 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-46400147-6391-4bf6-baa7-1d6a331101e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:43.275388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-46400147-6391-4bf6-baa7-1d6a331101e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:43.282314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-46400147-6391-4bf6-baa7-1d6a331101e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:43.283876 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-46400147-6391-4bf6-baa7-1d6a331101e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:43.283876 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-46400147-6391-4bf6-baa7-1d6a331101e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:43.284114 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-46400147-6391-4bf6-baa7-1d6a331101e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:43.466574 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-46400147-6391-4bf6-baa7-1d6a331101e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:43.472660 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-46400147-6391-4bf6-baa7-1d6a331101e7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1507 microversion: 2.1 time: 0.202195 May 26 20:28:43.473259 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 280/556] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:43 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:43.799895 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-39053038-6952-425e-a2a9-53bedb1fc23c req-f10870ab-6376-4879-89c8-6e534c9dfad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b0640b-f71f-43b5-b9c6-bac52df82796", "name": "network-vif-deleted", "tag": "f7c54df1-d39f-4aff-83be-3bcd00c8c9cd"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:43.814841 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-39053038-6952-425e-a2a9-53bedb1fc23c req-f10870ab-6376-4879-89c8-6e534c9dfad4 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:43.816736 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-39053038-6952-425e-a2a9-53bedb1fc23c req-f10870ab-6376-4879-89c8-6e534c9dfad4 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:43.831869 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-39053038-6952-425e-a2a9-53bedb1fc23c req-f10870ab-6376-4879-89c8-6e534c9dfad4 service nova] Creating event network-vif-deleted:f7c54df1-d39f-4aff-83be-3bcd00c8c9cd for instance 50b0640b-f71f-43b5-b9c6-bac52df82796 on hv-cinder-84213 May 26 20:28:43.838138 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-39053038-6952-425e-a2a9-53bedb1fc23c req-f10870ab-6376-4879-89c8-6e534c9dfad4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043278 May 26 20:28:43.839179 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 277/557] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:43.943602 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-534a35cb-4695-4876-b65a-d04862b23416 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:43.944575 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-534a35cb-4695-4876-b65a-d04862b23416 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:43.952068 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-534a35cb-4695-4876-b65a-d04862b23416 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:43.952518 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-534a35cb-4695-4876-b65a-d04862b23416 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:43.953298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-534a35cb-4695-4876-b65a-d04862b23416 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:43.953734 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-534a35cb-4695-4876-b65a-d04862b23416 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:44.116680 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-534a35cb-4695-4876-b65a-d04862b23416 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:44.126959 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-534a35cb-4695-4876-b65a-d04862b23416 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1363 microversion: 2.1 time: 0.187297 May 26 20:28:44.127801 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 281/558] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:43 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:44.491539 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-efce44de-30cd-4e9f-8021-937e000702b7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:44.492342 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-efce44de-30cd-4e9f-8021-937e000702b7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:44.499709 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-efce44de-30cd-4e9f-8021-937e000702b7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:44.500160 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-efce44de-30cd-4e9f-8021-937e000702b7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:44.500969 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-efce44de-30cd-4e9f-8021-937e000702b7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:44.501402 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-efce44de-30cd-4e9f-8021-937e000702b7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:44.586092 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-efce44de-30cd-4e9f-8021-937e000702b7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:44.594539 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-efce44de-30cd-4e9f-8021-937e000702b7 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1465 microversion: 2.1 time: 0.107572 May 26 20:28:44.595126 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 278/559] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:44 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1465 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:45.143882 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-05e52e94-2aa3-4acf-8ed2-389e1a9832a0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:45.144498 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-05e52e94-2aa3-4acf-8ed2-389e1a9832a0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:45.156887 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-05e52e94-2aa3-4acf-8ed2-389e1a9832a0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:45.157640 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-05e52e94-2aa3-4acf-8ed2-389e1a9832a0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:45.158603 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-05e52e94-2aa3-4acf-8ed2-389e1a9832a0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:45.161791 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-05e52e94-2aa3-4acf-8ed2-389e1a9832a0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:45.358947 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-05e52e94-2aa3-4acf-8ed2-389e1a9832a0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:45.372202 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-05e52e94-2aa3-4acf-8ed2-389e1a9832a0 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1363 microversion: 2.1 time: 0.231822 May 26 20:28:45.373657 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 282/560] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:45 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:45.612720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9da13181-2625-4ef6-bee8-2507faed9dad tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:45.613482 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9da13181-2625-4ef6-bee8-2507faed9dad tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:45.617321 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=8 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:45.618229 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=4 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:45.627656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9da13181-2625-4ef6-bee8-2507faed9dad tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:45.627656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9da13181-2625-4ef6-bee8-2507faed9dad tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:45.627656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9da13181-2625-4ef6-bee8-2507faed9dad tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:45.627656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9da13181-2625-4ef6-bee8-2507faed9dad tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:45.667817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9da13181-2625-4ef6-bee8-2507faed9dad tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:45.668819 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9da13181-2625-4ef6-bee8-2507faed9dad tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:45.670014 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-9da13181-2625-4ef6-bee8-2507faed9dad tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lazy-loading 'fault' on Instance uuid 50b0640b-f71f-43b5-b9c6-bac52df82796 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:28:45.722999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9da13181-2625-4ef6-bee8-2507faed9dad tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:45.731408 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9da13181-2625-4ef6-bee8-2507faed9dad tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 200 len: 1312 microversion: 2.1 time: 0.122572 May 26 20:28:45.741939 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 279/561] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:45 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:28:46.390170 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-f485d00f-6ca0-42d7-bd47-804be0c89181 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:46.390814 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-f485d00f-6ca0-42d7-bd47-804be0c89181 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:46.397477 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f485d00f-6ca0-42d7-bd47-804be0c89181 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:46.397922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f485d00f-6ca0-42d7-bd47-804be0c89181 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:46.398712 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f485d00f-6ca0-42d7-bd47-804be0c89181 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:46.399147 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f485d00f-6ca0-42d7-bd47-804be0c89181 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:46.539479 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-f485d00f-6ca0-42d7-bd47-804be0c89181 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:46.548462 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-f485d00f-6ca0-42d7-bd47-804be0c89181 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1363 microversion: 2.1 time: 0.162320 May 26 20:28:46.549083 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 283/562] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:46 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:46.748597 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-063552c5-b2fb-4c77-8708-85cce3ed50be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:46.749336 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-063552c5-b2fb-4c77-8708-85cce3ed50be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 50b0640b-f71f-43b5-b9c6-bac52df82796] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:46.757852 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-063552c5-b2fb-4c77-8708-85cce3ed50be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:46.761037 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-063552c5-b2fb-4c77-8708-85cce3ed50be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:46.761427 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-063552c5-b2fb-4c77-8708-85cce3ed50be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:46.762108 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-063552c5-b2fb-4c77-8708-85cce3ed50be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:46.779945 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-063552c5-b2fb-4c77-8708-85cce3ed50be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] HTTP exception thrown: Instance 50b0640b-f71f-43b5-b9c6-bac52df82796 could not be found. May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-063552c5-b2fb-4c77-8708-85cce3ed50be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Request method failure captured: May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 HTTP/1.1 May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HMctYnQef_fAFPqfLUdEsnXRp3PwFjMEZRaQa7XPlJWn0X3l7DHadWcb2y0MoBJ1Hg8jC9EJQtLjfc-f0GM-q2csWz-teo7cHIAXDxZzA1vXKbu_xP23ZMRI-6Dd4cd3BeN3sMIbgVw_F3vNl2TJ_XqOLmKvEG7iH0NVNfQM8lyCE May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: f6160118ba95403e8df08ac74982954d May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:28:46.782458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:28:46.783817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f6160118ba95403e8df08ac74982954d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6160118ba95403e8df08ac74982954d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f6160118ba95403e8df08ac74982954d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6160118ba95403e8df08ac74982954d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:28:46.783817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:28:46.783817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: f6160118ba95403e8df08ac74982954d May 26 20:28:46.783817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:28:46.783817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-ServerRescueNegativeTestJSON-1606344399-project May 26 20:28:46.783817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:28:46.783817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:28:46.783817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 146a7d1f40854f859864d463f403178f May 26 20:28:46.783817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606344399-project May 26 20:28:46.783817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:28:46.783817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 50b0640b-f71f-43b5-b9c6-bac52df82796 could not be found. May 26 20:28:46.783817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '50b0640b-f71f-43b5-b9c6-bac52df82796'} May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50b0640b-f71f-43b5-b9c6-bac52df82796 could not be found. May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:28:46.784537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50b0640b-f71f-43b5-b9c6-bac52df82796 could not be found. May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50b0640b-f71f-43b5-b9c6-bac52df82796 could not be found. May 26 20:28:46.785765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:46.787037 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-063552c5-b2fb-4c77-8708-85cce3ed50be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Returning 404 to user: Instance 50b0640b-f71f-43b5-b9c6-bac52df82796 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:28:46.787037 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-063552c5-b2fb-4c77-8708-85cce3ed50be tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796" status: 404 len: 111 microversion: 2.1 time: 0.038481 May 26 20:28:46.787037 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 280/563] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:46 2022] GET /compute/v2.1/servers/50b0640b-f71f-43b5-b9c6-bac52df82796 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:28:46.796163 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-259356f5-6297-41f7-80b3-a823d59bf57e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:46.796667 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-259356f5-6297-41f7-80b3-a823d59bf57e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:46.803214 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-259356f5-6297-41f7-80b3-a823d59bf57e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:46.803660 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-259356f5-6297-41f7-80b3-a823d59bf57e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:46.804433 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-259356f5-6297-41f7-80b3-a823d59bf57e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:46.804865 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-259356f5-6297-41f7-80b3-a823d59bf57e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:46.835285 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-259356f5-6297-41f7-80b3-a823d59bf57e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Going to try to terminate instance {{(pid=118306) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:28:46.857378 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8772780a-5cda-4d52-80aa-f5398ecf9c26 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:46.858206 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8772780a-5cda-4d52-80aa-f5398ecf9c26 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:46.864956 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8772780a-5cda-4d52-80aa-f5398ecf9c26 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:46.865412 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8772780a-5cda-4d52-80aa-f5398ecf9c26 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:46.866192 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8772780a-5cda-4d52-80aa-f5398ecf9c26 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:46.866660 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8772780a-5cda-4d52-80aa-f5398ecf9c26 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:47.036062 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-8772780a-5cda-4d52-80aa-f5398ecf9c26 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:47.044840 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8772780a-5cda-4d52-80aa-f5398ecf9c26 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1593 microversion: 2.1 time: 0.192139 May 26 20:28:47.045620 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 281/564] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:46 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1593 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:47.073309 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-259356f5-6297-41f7-80b3-a823d59bf57e tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 204 len: 0 microversion: 2.1 time: 0.281444 May 26 20:28:47.078517 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 284/565] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:28:46 2022] DELETE /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:28:47.092085 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-728cd697-de52-4324-a2b5-42e24523b4fe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:47.092740 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-728cd697-de52-4324-a2b5-42e24523b4fe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:47.101413 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-728cd697-de52-4324-a2b5-42e24523b4fe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:47.102043 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-728cd697-de52-4324-a2b5-42e24523b4fe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:47.102946 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-728cd697-de52-4324-a2b5-42e24523b4fe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:47.103386 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-728cd697-de52-4324-a2b5-42e24523b4fe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:47.144321 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-ffd7b212-9be8-4f66-994a-b92f574e5e54 req-35a6542d-3473-4731-b661-cb574424de45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0bd3fb-4338-41a5-84ab-d70795eeb59e", "name": "network-vif-plugged", "status": "completed", "tag": "9bd4765f-7998-4f04-8160-2f7cf452abe1"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:47.154011 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-ffd7b212-9be8-4f66-994a-b92f574e5e54 req-35a6542d-3473-4731-b661-cb574424de45 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:47.154485 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-ffd7b212-9be8-4f66-994a-b92f574e5e54 req-35a6542d-3473-4731-b661-cb574424de45 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:47.171607 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-ffd7b212-9be8-4f66-994a-b92f574e5e54 req-35a6542d-3473-4731-b661-cb574424de45 service nova] Creating event network-vif-plugged:9bd4765f-7998-4f04-8160-2f7cf452abe1 for instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e on hv-cinder-84213 May 26 20:28:47.179036 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-ffd7b212-9be8-4f66-994a-b92f574e5e54 req-35a6542d-3473-4731-b661-cb574424de45 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042317 May 26 20:28:47.180400 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 285/566] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:28:47.298372 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-728cd697-de52-4324-a2b5-42e24523b4fe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:47.305247 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-728cd697-de52-4324-a2b5-42e24523b4fe tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.220465 May 26 20:28:47.305985 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 282/567] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:47 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:28:47.567889 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0bbdd335-03d7-4695-b9fa-3ff4c6bec3ec tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:47.569289 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0bbdd335-03d7-4695-b9fa-3ff4c6bec3ec tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:47.576886 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0bbdd335-03d7-4695-b9fa-3ff4c6bec3ec tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:47.577546 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0bbdd335-03d7-4695-b9fa-3ff4c6bec3ec tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:47.578364 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0bbdd335-03d7-4695-b9fa-3ff4c6bec3ec tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:47.578996 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0bbdd335-03d7-4695-b9fa-3ff4c6bec3ec tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:47.791089 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-0bbdd335-03d7-4695-b9fa-3ff4c6bec3ec tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:47.799266 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0bbdd335-03d7-4695-b9fa-3ff4c6bec3ec tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1363 microversion: 2.1 time: 0.237077 May 26 20:28:47.799849 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 286/568] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:47 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:48.324072 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9fbd24a3-2b6e-46c2-bfa4-c4cbaed70148 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:48.325051 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9fbd24a3-2b6e-46c2-bfa4-c4cbaed70148 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:48.331268 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9fbd24a3-2b6e-46c2-bfa4-c4cbaed70148 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:48.331718 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9fbd24a3-2b6e-46c2-bfa4-c4cbaed70148 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:48.332482 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9fbd24a3-2b6e-46c2-bfa4-c4cbaed70148 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:48.332919 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9fbd24a3-2b6e-46c2-bfa4-c4cbaed70148 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:48.481735 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9fbd24a3-2b6e-46c2-bfa4-c4cbaed70148 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:48.497752 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9fbd24a3-2b6e-46c2-bfa4-c4cbaed70148 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.171630 May 26 20:28:48.499797 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 283/569] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:48 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:48.820876 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9e709548-1300-41a5-bae0-0b6ce00913d4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:48.821495 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9e709548-1300-41a5-bae0-0b6ce00913d4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:48.832336 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9e709548-1300-41a5-bae0-0b6ce00913d4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:48.832336 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9e709548-1300-41a5-bae0-0b6ce00913d4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:48.832336 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9e709548-1300-41a5-bae0-0b6ce00913d4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:48.832336 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9e709548-1300-41a5-bae0-0b6ce00913d4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:49.129661 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9e709548-1300-41a5-bae0-0b6ce00913d4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:49.138556 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9e709548-1300-41a5-bae0-0b6ce00913d4 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1363 microversion: 2.1 time: 0.320433 May 26 20:28:49.139138 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 287/570] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:48 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:49.514828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6f75a9b7-3995-408b-9b2a-0d35a4a5ced6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:49.515503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6f75a9b7-3995-408b-9b2a-0d35a4a5ced6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:49.522778 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6f75a9b7-3995-408b-9b2a-0d35a4a5ced6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:49.523285 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6f75a9b7-3995-408b-9b2a-0d35a4a5ced6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:49.524440 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6f75a9b7-3995-408b-9b2a-0d35a4a5ced6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:49.524992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6f75a9b7-3995-408b-9b2a-0d35a4a5ced6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:49.662643 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6f75a9b7-3995-408b-9b2a-0d35a4a5ced6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:49.671373 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6f75a9b7-3995-408b-9b2a-0d35a4a5ced6 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.160408 May 26 20:28:49.672158 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 284/571] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:49 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:50.156511 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-98222991-15a0-4a8b-acec-c1b7d8b1a199 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:50.161005 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-98222991-15a0-4a8b-acec-c1b7d8b1a199 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:50.164964 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-98222991-15a0-4a8b-acec-c1b7d8b1a199 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:50.165490 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-98222991-15a0-4a8b-acec-c1b7d8b1a199 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:50.166357 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-98222991-15a0-4a8b-acec-c1b7d8b1a199 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:50.167006 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-98222991-15a0-4a8b-acec-c1b7d8b1a199 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:50.355583 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-98222991-15a0-4a8b-acec-c1b7d8b1a199 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:50.361908 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-98222991-15a0-4a8b-acec-c1b7d8b1a199 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1363 microversion: 2.1 time: 0.210374 May 26 20:28:50.362803 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 288/572] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:50 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:50.376842 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-505bdc4d-5576-402b-81b3-4101c9b36a8e req-038b29f8-2761-44a5-8a73-25732259225b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6f1ba5-371c-4465-8534-2eb1ef60acdb", "tag": "a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:50.385413 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-505bdc4d-5576-402b-81b3-4101c9b36a8e req-038b29f8-2761-44a5-8a73-25732259225b service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:50.385956 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-505bdc4d-5576-402b-81b3-4101c9b36a8e req-038b29f8-2761-44a5-8a73-25732259225b service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:50.398374 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-505bdc4d-5576-402b-81b3-4101c9b36a8e req-038b29f8-2761-44a5-8a73-25732259225b service nova] Creating event network-changed:a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d for instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb on hv-cinder-84213 May 26 20:28:50.403430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-505bdc4d-5576-402b-81b3-4101c9b36a8e req-038b29f8-2761-44a5-8a73-25732259225b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108157 May 26 20:28:50.404102 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 285/573] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:28:50.690200 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-81732969-f2c9-447a-8f52-dbb555c1cb52 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:50.691214 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-81732969-f2c9-447a-8f52-dbb555c1cb52 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:50.699370 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-81732969-f2c9-447a-8f52-dbb555c1cb52 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:50.707267 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-81732969-f2c9-447a-8f52-dbb555c1cb52 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:50.707267 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-81732969-f2c9-447a-8f52-dbb555c1cb52 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:50.707267 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-81732969-f2c9-447a-8f52-dbb555c1cb52 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:50.991365 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-81732969-f2c9-447a-8f52-dbb555c1cb52 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:51.009491 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-81732969-f2c9-447a-8f52-dbb555c1cb52 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1522 microversion: 2.1 time: 0.323935 May 26 20:28:51.020973 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 289/574] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:50 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:51.380761 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3d449465-682c-4dfc-85b2-a6925b311f29 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:51.381584 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3d449465-682c-4dfc-85b2-a6925b311f29 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:51.389461 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3d449465-682c-4dfc-85b2-a6925b311f29 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:51.390229 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3d449465-682c-4dfc-85b2-a6925b311f29 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:51.391081 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3d449465-682c-4dfc-85b2-a6925b311f29 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:51.391459 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3d449465-682c-4dfc-85b2-a6925b311f29 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:51.461337 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-2441047a-aa77-4c03-b774-0ab74f61e757 req-dccd64de-9746-423d-9a21-e4a88808c284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f23bb01-825e-4dcf-a2a0-e75b6c8928ab", "name": "network-vif-deleted", "tag": "fd4a262c-5c5f-4b05-ac17-c0c6aed612e9"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:51.470932 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-2441047a-aa77-4c03-b774-0ab74f61e757 req-dccd64de-9746-423d-9a21-e4a88808c284 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:51.471384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-2441047a-aa77-4c03-b774-0ab74f61e757 req-dccd64de-9746-423d-9a21-e4a88808c284 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:51.486228 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-2441047a-aa77-4c03-b774-0ab74f61e757 req-dccd64de-9746-423d-9a21-e4a88808c284 service nova] Creating event network-vif-deleted:fd4a262c-5c5f-4b05-ac17-c0c6aed612e9 for instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab on hv-cinder-84213 May 26 20:28:51.488555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-2441047a-aa77-4c03-b774-0ab74f61e757 req-dccd64de-9746-423d-9a21-e4a88808c284 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030915 May 26 20:28:51.489338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 290/575] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:28:51.639985 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-3d449465-682c-4dfc-85b2-a6925b311f29 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:51.647492 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3d449465-682c-4dfc-85b2-a6925b311f29 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1363 microversion: 2.1 time: 0.271437 May 26 20:28:51.648079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 286/576] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:51 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:52.028577 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-dec901f1-e0dc-48df-8249-bd7327efc853 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:52.030280 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-dec901f1-e0dc-48df-8249-bd7327efc853 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:52.038828 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dec901f1-e0dc-48df-8249-bd7327efc853 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:52.039279 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dec901f1-e0dc-48df-8249-bd7327efc853 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:52.040340 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dec901f1-e0dc-48df-8249-bd7327efc853 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:52.040783 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dec901f1-e0dc-48df-8249-bd7327efc853 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:52.074152 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:52.077557 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dec901f1-e0dc-48df-8249-bd7327efc853 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:52.078002 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dec901f1-e0dc-48df-8249-bd7327efc853 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:52.078474 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-dec901f1-e0dc-48df-8249-bd7327efc853 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lazy-loading 'fault' on Instance uuid 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:28:52.123373 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-dec901f1-e0dc-48df-8249-bd7327efc853 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:52.131254 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-dec901f1-e0dc-48df-8249-bd7327efc853 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1312 microversion: 2.1 time: 0.107807 May 26 20:28:52.131846 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 291/577] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:52 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:52.669219 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2c84ff95-074c-4748-956f-a744deeae517 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:52.669219 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2c84ff95-074c-4748-956f-a744deeae517 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:52.675144 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c84ff95-074c-4748-956f-a744deeae517 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:52.675981 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c84ff95-074c-4748-956f-a744deeae517 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:52.676651 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c84ff95-074c-4748-956f-a744deeae517 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:52.677304 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c84ff95-074c-4748-956f-a744deeae517 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:52.814255 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2c84ff95-074c-4748-956f-a744deeae517 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:52.822020 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2c84ff95-074c-4748-956f-a744deeae517 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1363 microversion: 2.1 time: 0.159708 May 26 20:28:52.822641 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 287/578] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:52 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:53.149511 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b966978e-f0af-494e-a7c0-6acedee9e9cf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:53.150165 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b966978e-f0af-494e-a7c0-6acedee9e9cf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:53.152006 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=4 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:53.158581 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b966978e-f0af-494e-a7c0-6acedee9e9cf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:53.160959 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b966978e-f0af-494e-a7c0-6acedee9e9cf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:53.160959 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b966978e-f0af-494e-a7c0-6acedee9e9cf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:53.160959 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b966978e-f0af-494e-a7c0-6acedee9e9cf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:53.194581 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b966978e-f0af-494e-a7c0-6acedee9e9cf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:53.195033 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b966978e-f0af-494e-a7c0-6acedee9e9cf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:53.195502 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-b966978e-f0af-494e-a7c0-6acedee9e9cf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lazy-loading 'fault' on Instance uuid 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:28:53.225833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-21e5ce35-93b1-4cc8-96a1-21e0548e9baf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:53.226459 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-21e5ce35-93b1-4cc8-96a1-21e0548e9baf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:53.233169 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-21e5ce35-93b1-4cc8-96a1-21e0548e9baf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:53.233765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-21e5ce35-93b1-4cc8-96a1-21e0548e9baf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:53.234656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-21e5ce35-93b1-4cc8-96a1-21e0548e9baf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:53.235172 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-21e5ce35-93b1-4cc8-96a1-21e0548e9baf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:53.243644 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b966978e-f0af-494e-a7c0-6acedee9e9cf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146a7d1f40854f859864d463f403178f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6160118ba95403e8df08ac74982954d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:53.253852 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b966978e-f0af-494e-a7c0-6acedee9e9cf tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 200 len: 1312 microversion: 2.1 time: 0.108516 May 26 20:28:53.258567 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 292/579] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:53 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:53.260482 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-21e5ce35-93b1-4cc8-96a1-21e0548e9baf tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/ips" status: 200 len: 149 microversion: 2.1 time: 0.038612 May 26 20:28:53.261139 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 288/580] 10.222.0.44 () {58 vars in 1247 bytes} [Thu May 26 20:28:53 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:28:53.313646 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0467f69d-d843-43e4-a959-021aa049b65e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2107456738"}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:53.314185 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0467f69d-d843-43e4-a959-021aa049b65e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:53.321042 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0467f69d-d843-43e4-a959-021aa049b65e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:53.321423 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0467f69d-d843-43e4-a959-021aa049b65e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:53.322292 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0467f69d-d843-43e4-a959-021aa049b65e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:53.322731 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0467f69d-d843-43e4-a959-021aa049b65e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:53.466128 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.network.security_group_api [None req-0467f69d-d843-43e4-a959-021aa049b65e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Adding security group 1d90443c-fd20-4c27-b01e-7f825fc21bb1 to port a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d May 26 20:28:53.839733 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-512cdd6a-189b-4795-aa88-e88c486d99a8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:53.841217 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-512cdd6a-189b-4795-aa88-e88c486d99a8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:53.848081 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-512cdd6a-189b-4795-aa88-e88c486d99a8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:53.848473 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-512cdd6a-189b-4795-aa88-e88c486d99a8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:53.849262 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-512cdd6a-189b-4795-aa88-e88c486d99a8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:53.849712 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-512cdd6a-189b-4795-aa88-e88c486d99a8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:53.990147 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0467f69d-d843-43e4-a959-021aa049b65e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "POST /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/action" status: 202 len: 0 microversion: 2.1 time: 0.681554 May 26 20:28:53.991472 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 293/581] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:28:53 2022] POST /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:28:54.000463 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-adbe2c7d-7053-44f8-bb24-6f966dcec848 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:54.001513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-adbe2c7d-7053-44f8-bb24-6f966dcec848 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:54.017749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-adbe2c7d-7053-44f8-bb24-6f966dcec848 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:54.017749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-adbe2c7d-7053-44f8-bb24-6f966dcec848 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:54.017749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-adbe2c7d-7053-44f8-bb24-6f966dcec848 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:54.017749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-adbe2c7d-7053-44f8-bb24-6f966dcec848 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:54.018359 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-512cdd6a-189b-4795-aa88-e88c486d99a8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:54.026566 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-512cdd6a-189b-4795-aa88-e88c486d99a8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1549 microversion: 2.1 time: 0.190536 May 26 20:28:54.040334 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 289/582] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:53 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1549 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:28:54.057929 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-7c8767b4-63df-47dd-b492-b31ffb54a72a req-9ef03fe7-5e55-4ee6-aab6-8f7aedbf7db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6f1ba5-371c-4465-8534-2eb1ef60acdb", "tag": "a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:54.067084 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-7c8767b4-63df-47dd-b492-b31ffb54a72a req-9ef03fe7-5e55-4ee6-aab6-8f7aedbf7db8 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:54.067787 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-7c8767b4-63df-47dd-b492-b31ffb54a72a req-9ef03fe7-5e55-4ee6-aab6-8f7aedbf7db8 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:54.081387 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-7c8767b4-63df-47dd-b492-b31ffb54a72a req-9ef03fe7-5e55-4ee6-aab6-8f7aedbf7db8 service nova] Creating event network-changed:a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d for instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb on hv-cinder-84213 May 26 20:28:54.087347 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-7c8767b4-63df-47dd-b492-b31ffb54a72a req-9ef03fe7-5e55-4ee6-aab6-8f7aedbf7db8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045012 May 26 20:28:54.087347 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 290/583] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:54.092767 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-69e1ff66-b44a-479e-b78a-d11fd178e4e1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:54.093341 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-69e1ff66-b44a-479e-b78a-d11fd178e4e1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:54.100181 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-69e1ff66-b44a-479e-b78a-d11fd178e4e1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:54.100968 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-69e1ff66-b44a-479e-b78a-d11fd178e4e1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:54.102197 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-69e1ff66-b44a-479e-b78a-d11fd178e4e1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:54.102880 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-69e1ff66-b44a-479e-b78a-d11fd178e4e1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:54.224925 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-69e1ff66-b44a-479e-b78a-d11fd178e4e1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136381 May 26 20:28:54.225530 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 291/584] 10.222.0.44 () {58 vars in 1274 bytes} [Thu May 26 20:28:54 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:54.239597 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-adbe2c7d-7053-44f8-bb24-6f966dcec848 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:28:54.256859 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-adbe2c7d-7053-44f8-bb24-6f966dcec848 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1759 microversion: 2.1 time: 0.256428 May 26 20:28:54.259555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 294/585] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:53 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1759 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:28:54.276756 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d2bdf505-62c5-4e4e-b036-16909bf393b1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:28:54.277822 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d2bdf505-62c5-4e4e-b036-16909bf393b1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] [instance: 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:54.284971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2bdf505-62c5-4e4e-b036-16909bf393b1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:54.285824 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2bdf505-62c5-4e4e-b036-16909bf393b1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:54.286898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2bdf505-62c5-4e4e-b036-16909bf393b1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:54.287575 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2bdf505-62c5-4e4e-b036-16909bf393b1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-d2bdf505-62c5-4e4e-b036-16909bf393b1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] HTTP exception thrown: Instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab could not be found. May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d2bdf505-62c5-4e4e-b036-16909bf393b1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Request method failure captured: May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab HTTP/1.1 May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HMctYnQef_fAFPqfLUdEsnXRp3PwFjMEZRaQa7XPlJWn0X3l7DHadWcb2y0MoBJ1Hg8jC9EJQtLjfc-f0GM-q2csWz-teo7cHIAXDxZzA1vXKbu_xP23ZMRI-6Dd4cd3BeN3sMIbgVw_F3vNl2TJ_XqOLmKvEG7iH0NVNfQM8lyCE May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: f6160118ba95403e8df08ac74982954d May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:28:54.309951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:28:54.311632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f6160118ba95403e8df08ac74982954d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6160118ba95403e8df08ac74982954d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f6160118ba95403e8df08ac74982954d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f6160118ba95403e8df08ac74982954d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:28:54.311632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:28:54.311632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: f6160118ba95403e8df08ac74982954d May 26 20:28:54.311632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606344399 May 26 20:28:54.311632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-ServerRescueNegativeTestJSON-1606344399-project May 26 20:28:54.311632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:28:54.311632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:28:54.311632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 146a7d1f40854f859864d463f403178f May 26 20:28:54.311632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606344399-project May 26 20:28:54.311632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:28:54.311632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab could not be found. May 26 20:28:54.311632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '1f23bb01-825e-4dcf-a2a0-e75b6c8928ab'} May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab could not be found. May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:28:54.312409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab could not be found. May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab could not be found. May 26 20:28:54.313664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:28:54.316251 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d2bdf505-62c5-4e4e-b036-16909bf393b1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] Returning 404 to user: Instance 1f23bb01-825e-4dcf-a2a0-e75b6c8928ab could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:28:54.316251 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d2bdf505-62c5-4e4e-b036-16909bf393b1 tempest-ServerRescueNegativeTestJSON-1606344399 tempest-ServerRescueNegativeTestJSON-1606344399-project] 10.222.0.44 "GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab" status: 404 len: 111 microversion: 2.1 time: 0.040811 May 26 20:28:54.317555 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 292/586] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:28:54 2022] GET /compute/v2.1/servers/1f23bb01-825e-4dcf-a2a0-e75b6c8928ab => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:28:54.907674 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0234148e-3d5d-4de8-bba3-1af74eef693c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32587d03-7850-4b26-8278-b8eff129e07a"}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:54.909129 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0234148e-3d5d-4de8-bba3-1af74eef693c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:28:54.924300 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0234148e-3d5d-4de8-bba3-1af74eef693c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:54.924865 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0234148e-3d5d-4de8-bba3-1af74eef693c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:54.926715 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0234148e-3d5d-4de8-bba3-1af74eef693c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:54.929790 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0234148e-3d5d-4de8-bba3-1af74eef693c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:54.959371 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:55.739227 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0234148e-3d5d-4de8-bba3-1af74eef693c tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835719 May 26 20:28:55.739939 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 295/587] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:28:54 2022] POST /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:28:56.075323 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-f53ac7c4-b44a-4d80-9061-44bc8f444542 req-a72604b0-9ca5-4c81-a079-ff3148f05b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0bd3fb-4338-41a5-84ab-d70795eeb59e", "tag": "9bd4765f-7998-4f04-8160-2f7cf452abe1"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:28:56.092875 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f53ac7c4-b44a-4d80-9061-44bc8f444542 req-a72604b0-9ca5-4c81-a079-ff3148f05b8b service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:28:56.093670 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f53ac7c4-b44a-4d80-9061-44bc8f444542 req-a72604b0-9ca5-4c81-a079-ff3148f05b8b service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:28:56.121969 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-f53ac7c4-b44a-4d80-9061-44bc8f444542 req-a72604b0-9ca5-4c81-a079-ff3148f05b8b service nova] Creating event network-changed:9bd4765f-7998-4f04-8160-2f7cf452abe1 for instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e on hv-cinder-84213 May 26 20:28:56.128116 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-f53ac7c4-b44a-4d80-9061-44bc8f444542 req-a72604b0-9ca5-4c81-a079-ff3148f05b8b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056484 May 26 20:28:56.129359 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 293/588] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:02.006035 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-279987465", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1889197979", "security_groups": [{"name": "tempest-secgroup-smoke-1530768605"}], "block_device_mapping_v2": [{"uuid": "286f1d6a-67ab-4b7b-80c9-516637b7c6e6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48289956-58c4-46df-a124-8d17ca1f3535"}]}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:02.255882 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.network.neutron [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] validate_networks() for [('48289956-58c4-46df-a124-8d17ca1f3535', None, None, None, None, None)] {{(pid=118306) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:29:02.987218 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Flavor limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:29:02.987640 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Image limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:29:02.988112 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Flavor pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:29:02.988555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Image pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:29:02.990964 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:29:03.002513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:03.008077 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:03.008077 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:03.008077 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:03.026571 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Getting quotas for project 772b1948bd9546669688fe60a8c9ba46. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:29:03.032213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Getting quotas for user 9558a9c3df27494d990d3b19f560b4d1 and project 772b1948bd9546669688fe60a8c9ba46. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:29:03.096686 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Going to run 1 instances... {{(pid=118306) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:29:03.099110 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='286f1d6a-67ab-4b7b-80c9-516637b7c6e6',volume_size=None,volume_type=None)] {{(pid=118306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:29:03.332614 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-72486722-b8f1-4242-a0b8-6f8c863139bd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32587d03-7850-4b26-8278-b8eff129e07a"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:03.333767 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-72486722-b8f1-4242-a0b8-6f8c863139bd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:03.335725 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:03.341054 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-72486722-b8f1-4242-a0b8-6f8c863139bd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:03.341779 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-72486722-b8f1-4242-a0b8-6f8c863139bd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:03.342820 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-72486722-b8f1-4242-a0b8-6f8c863139bd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:03.343491 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-72486722-b8f1-4242-a0b8-6f8c863139bd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:03.428274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-72486722-b8f1-4242-a0b8-6f8c863139bd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Invalid volume: volume 32587d03-7850-4b26-8278-b8eff129e07a is already attached to instances: 931728fa-007b-4441-97c1-602ae434cf8a May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-72486722-b8f1-4242-a0b8-6f8c863139bd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: POST /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments HTTP/1.1 May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 74 May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:29:03.430041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:29:03.437287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:29:03.437287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:29:03.437287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:29:03.437287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:29:03.437287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:29:03.437287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:29:03.437287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:29:03.437287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:29:03.437287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:29:03.437287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: May 26 20:29:03.437287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {"volumeAttachment": {"volumeId": "32587d03-7850-4b26-8278-b8eff129e07a"}} May 26 20:29:03.437287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Invalid volume: volume 32587d03-7850-4b26-8278-b8eff129e07a is already attached to instances: 931728fa-007b-4441-97c1-602ae434cf8a May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'server_id': '931728fa-007b-4441-97c1-602ae434cf8a', 'body': {'volumeAttachment': {'volumeId': '32587d03-7850-4b26-8278-b8eff129e07a'}}} May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 32587d03-7850-4b26-8278-b8eff129e07a is already attached to instances: 931728fa-007b-4441-97c1-602ae434cf8a May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:29:03.438027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 32587d03-7850-4b26-8278-b8eff129e07a is already attached to instances: 931728fa-007b-4441-97c1-602ae434cf8a May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:29:03.439695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:29:03.440897 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:29:03.440897 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:29:03.440897 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:29:03.440897 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 32587d03-7850-4b26-8278-b8eff129e07a is already attached to instances: 931728fa-007b-4441-97c1-602ae434cf8a May 26 20:29:03.440897 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:29:03.440897 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-72486722-b8f1-4242-a0b8-6f8c863139bd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 400 to user: Invalid volume: volume 32587d03-7850-4b26-8278-b8eff129e07a is already attached to instances: 931728fa-007b-4441-97c1-602ae434cf8a {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:29:03.440897 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-72486722-b8f1-4242-a0b8-6f8c863139bd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104076 May 26 20:29:03.440897 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 294/589] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:29:03 2022] POST /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 20:29:03.500169 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8b917e53-3d74-42c8-9cdd-2073c0d11167 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:03.500676 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8b917e53-3d74-42c8-9cdd-2073c0d11167 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:03.507654 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b917e53-3d74-42c8-9cdd-2073c0d11167 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:03.508105 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b917e53-3d74-42c8-9cdd-2073c0d11167 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:03.511127 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b917e53-3d74-42c8-9cdd-2073c0d11167 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:03.511127 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8b917e53-3d74-42c8-9cdd-2073c0d11167 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:03.573432 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8c2cbf4b-2fd0-4b39-ae3b-3d05bc26bdcf tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.574926 May 26 20:29:03.581177 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 296/590] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:29:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:29:03.587762 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c4d38d24-46ef-4d7c-9628-00f3701f24af tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:03.588730 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c4d38d24-46ef-4d7c-9628-00f3701f24af tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:03.613302 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-8b917e53-3d74-42c8-9cdd-2073c0d11167 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lazy-loading 'services' on Instance uuid 931728fa-007b-4441-97c1-602ae434cf8a {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:29:03.700224 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c4d38d24-46ef-4d7c-9628-00f3701f24af tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:03.711058 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c4d38d24-46ef-4d7c-9628-00f3701f24af tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1094 microversion: 2.1 time: 0.128020 May 26 20:29:03.711647 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 297/591] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:03 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1094 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:03.937596 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8b917e53-3d74-42c8-9cdd-2073c0d11167 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments/32587d03-7850-4b26-8278-b8eff129e07a" status: 202 len: 0 microversion: 2.1 time: 0.442186 May 26 20:29:03.938560 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 295/592] 10.222.0.44 () {58 vars in 1415 bytes} [Thu May 26 20:29:03 2022] DELETE /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments/32587d03-7850-4b26-8278-b8eff129e07a => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 20:29:03.948943 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-35d99f3c-b7c1-4fdb-93a8-8c399bdb370f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:03.950031 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-35d99f3c-b7c1-4fdb-93a8-8c399bdb370f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:03.961806 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-35d99f3c-b7c1-4fdb-93a8-8c399bdb370f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:03.962809 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-35d99f3c-b7c1-4fdb-93a8-8c399bdb370f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:03.963858 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-35d99f3c-b7c1-4fdb-93a8-8c399bdb370f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:03.965897 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-35d99f3c-b7c1-4fdb-93a8-8c399bdb370f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:04.016236 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-35d99f3c-b7c1-4fdb-93a8-8c399bdb370f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072701 May 26 20:29:04.021900 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 298/593] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:29:03 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:29:04.729118 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-222a34d7-e4e7-44ac-b034-2f66826bfa13 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:04.729815 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-222a34d7-e4e7-44ac-b034-2f66826bfa13 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:04.818192 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-222a34d7-e4e7-44ac-b034-2f66826bfa13 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:04.826391 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-222a34d7-e4e7-44ac-b034-2f66826bfa13 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1094 microversion: 2.1 time: 0.101863 May 26 20:29:04.827559 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 296/594] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:04 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1094 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:05.029799 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5cba643c-ff17-42e5-ab2d-3e362bce50a7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:05.031753 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5cba643c-ff17-42e5-ab2d-3e362bce50a7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:05.038941 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5cba643c-ff17-42e5-ab2d-3e362bce50a7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:05.040034 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5cba643c-ff17-42e5-ab2d-3e362bce50a7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:05.041130 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5cba643c-ff17-42e5-ab2d-3e362bce50a7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:05.041782 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5cba643c-ff17-42e5-ab2d-3e362bce50a7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:05.075507 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5cba643c-ff17-42e5-ab2d-3e362bce50a7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050319 May 26 20:29:05.076725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 299/595] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:29:05 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:05.845068 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0af6307c-9147-400b-bc12-97fc75e67ba1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:05.852765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0af6307c-9147-400b-bc12-97fc75e67ba1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:05.854954 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0af6307c-9147-400b-bc12-97fc75e67ba1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:05.855782 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0af6307c-9147-400b-bc12-97fc75e67ba1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:05.857022 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0af6307c-9147-400b-bc12-97fc75e67ba1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:05.857694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0af6307c-9147-400b-bc12-97fc75e67ba1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:05.875085 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:05.928087 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-0af6307c-9147-400b-bc12-97fc75e67ba1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:05.938796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0af6307c-9147-400b-bc12-97fc75e67ba1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1192 microversion: 2.1 time: 0.098758 May 26 20:29:05.950568 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 297/596] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:05 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1192 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:06.097355 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7e3028be-f955-429b-a9af-ef2aa83f24ed tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:06.100705 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7e3028be-f955-429b-a9af-ef2aa83f24ed tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:06.114150 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7e3028be-f955-429b-a9af-ef2aa83f24ed tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:06.114150 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7e3028be-f955-429b-a9af-ef2aa83f24ed tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:06.119204 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7e3028be-f955-429b-a9af-ef2aa83f24ed tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:06.119828 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7e3028be-f955-429b-a9af-ef2aa83f24ed tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:06.177522 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7e3028be-f955-429b-a9af-ef2aa83f24ed tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092058 May 26 20:29:06.178826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 300/597] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:29:06 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 20:29:06.288227 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c451e848-a85e-4681-acca-264f90d78d16 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:06.288770 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c451e848-a85e-4681-acca-264f90d78d16 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:06.302919 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c451e848-a85e-4681-acca-264f90d78d16 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:06.303550 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c451e848-a85e-4681-acca-264f90d78d16 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:06.304621 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c451e848-a85e-4681-acca-264f90d78d16 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:06.305262 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c451e848-a85e-4681-acca-264f90d78d16 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:06.383758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c451e848-a85e-4681-acca-264f90d78d16 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:29:06.827316 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c451e848-a85e-4681-acca-264f90d78d16 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 204 len: 0 microversion: 2.1 time: 0.544090 May 26 20:29:06.845458 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-d61201d8-bfc5-4789-a462-cb3ab6075573 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:06.845864 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 298/598] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:29:06 2022] DELETE /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:29:06.851184 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-d61201d8-bfc5-4789-a462-cb3ab6075573 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:06.861829 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d61201d8-bfc5-4789-a462-cb3ab6075573 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:06.862706 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d61201d8-bfc5-4789-a462-cb3ab6075573 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:06.863772 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d61201d8-bfc5-4789-a462-cb3ab6075573 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:06.864565 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d61201d8-bfc5-4789-a462-cb3ab6075573 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:07.045984 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-941dd10e-1657-422e-97cd-b74001939c0e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Action: 'create', calling method: .version_select at 0x7f2da4394280>, body: {"keypair": {"name": "tempest-keypair-1401384039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUB80DYdqeiFLSzmcVJ6/f4kwfEmivq/gNhN2iHylZHr+DIcVsuXEUajScIucTXf19bU1mcIYr/8vSPy6GXeBZzrK1yfUFA3rUBrbo8yr4srCxricIy4u9VyQjLxb2XiQ=="}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:07.063495 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-941dd10e-1657-422e-97cd-b74001939c0e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Getting quotas for project 4df1452f8d474ea9b121f4aef1793af8. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:29:07.067703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-941dd10e-1657-422e-97cd-b74001939c0e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Getting quotas for user 2ecdb952539f401aba5e0f91c3dd8660 and project 4df1452f8d474ea9b121f4aef1793af8. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:29:07.080097 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-d61201d8-bfc5-4789-a462-cb3ab6075573 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:07.088345 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-d61201d8-bfc5-4789-a462-cb3ab6075573 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1679 microversion: 2.1 time: 0.255359 May 26 20:29:07.088926 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 301/599] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:06 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:07.100109 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8f62dc24-2934-45d9-afed-d71f53914d32 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:07.100784 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8f62dc24-2934-45d9-afed-d71f53914d32 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:07.109715 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8f62dc24-2934-45d9-afed-d71f53914d32 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:07.110298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8f62dc24-2934-45d9-afed-d71f53914d32 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:07.111285 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8f62dc24-2934-45d9-afed-d71f53914d32 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:07.111927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8f62dc24-2934-45d9-afed-d71f53914d32 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:07.177962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8f62dc24-2934-45d9-afed-d71f53914d32 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:07.187645 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-941dd10e-1657-422e-97cd-b74001939c0e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.339957 May 26 20:29:07.188432 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 299/600] 10.222.0.44 () {62 vars in 1199 bytes} [Thu May 26 20:29:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 342 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 20:29:07.194773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8f62dc24-2934-45d9-afed-d71f53914d32 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1210 microversion: 2.1 time: 0.103117 May 26 20:29:07.196060 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 302/601] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:07 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:08.108133 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d049b468-dbf2-461a-8ad9-58d57abfd36d tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:08.108896 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d049b468-dbf2-461a-8ad9-58d57abfd36d tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:08.130059 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d049b468-dbf2-461a-8ad9-58d57abfd36d tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:08.131450 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d049b468-dbf2-461a-8ad9-58d57abfd36d tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:08.132738 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d049b468-dbf2-461a-8ad9-58d57abfd36d tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:08.134590 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d049b468-dbf2-461a-8ad9-58d57abfd36d tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:08.220029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9ad7e8e7-907d-42fc-ab0d-257ec20be235 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:08.221254 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9ad7e8e7-907d-42fc-ab0d-257ec20be235 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:08.229051 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9ad7e8e7-907d-42fc-ab0d-257ec20be235 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:08.229792 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9ad7e8e7-907d-42fc-ab0d-257ec20be235 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:08.231347 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9ad7e8e7-907d-42fc-ab0d-257ec20be235 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:08.231983 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9ad7e8e7-907d-42fc-ab0d-257ec20be235 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:08.375673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-d049b468-dbf2-461a-8ad9-58d57abfd36d tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:08.389506 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d049b468-dbf2-461a-8ad9-58d57abfd36d tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1679 microversion: 2.1 time: 0.285754 May 26 20:29:08.390672 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 300/602] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:08 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1679 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:08.414766 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9ad7e8e7-907d-42fc-ab0d-257ec20be235 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:08.425954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9ad7e8e7-907d-42fc-ab0d-257ec20be235 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1278 microversion: 2.1 time: 0.208955 May 26 20:29:08.426574 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 303/603] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:08 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1278 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:29:09.407715 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eecded05-7fdf-407e-af5c-c687f5d27f82 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:09.411338 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eecded05-7fdf-407e-af5c-c687f5d27f82 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:09.414443 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eecded05-7fdf-407e-af5c-c687f5d27f82 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:09.415150 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eecded05-7fdf-407e-af5c-c687f5d27f82 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:09.416142 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eecded05-7fdf-407e-af5c-c687f5d27f82 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:09.416781 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eecded05-7fdf-407e-af5c-c687f5d27f82 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:09.444811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-de942361-a820-4cff-9be6-7f4c0a81518b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:09.446366 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-de942361-a820-4cff-9be6-7f4c0a81518b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:09.463221 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-de942361-a820-4cff-9be6-7f4c0a81518b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:09.463888 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-de942361-a820-4cff-9be6-7f4c0a81518b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:09.466099 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-de942361-a820-4cff-9be6-7f4c0a81518b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:09.466829 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-de942361-a820-4cff-9be6-7f4c0a81518b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:09.618977 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-de942361-a820-4cff-9be6-7f4c0a81518b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:09.629560 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-de942361-a820-4cff-9be6-7f4c0a81518b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1266 microversion: 2.1 time: 0.188465 May 26 20:29:09.630758 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 304/604] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:09 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:10.013365 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-eecded05-7fdf-407e-af5c-c687f5d27f82 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:10.021107 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eecded05-7fdf-407e-af5c-c687f5d27f82 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1679 microversion: 2.1 time: 0.617568 May 26 20:29:10.021694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 301/605] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:09 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1679 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:10.436149 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-08c0aa29-d70c-4239-b29f-57f931ede068 req-f107f8d6-e2c5-42a5-b781-12071cc1b9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39113a21-669c-497d-9364-469eec53967d", "tag": "b712f1a3-a312-49b0-b2f0-18cd232d399a"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:10.445209 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-08c0aa29-d70c-4239-b29f-57f931ede068 req-f107f8d6-e2c5-42a5-b781-12071cc1b9b1 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:10.451153 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-08c0aa29-d70c-4239-b29f-57f931ede068 req-f107f8d6-e2c5-42a5-b781-12071cc1b9b1 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:10.468689 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-08c0aa29-d70c-4239-b29f-57f931ede068 req-f107f8d6-e2c5-42a5-b781-12071cc1b9b1 service nova] Creating event network-changed:b712f1a3-a312-49b0-b2f0-18cd232d399a for instance 39113a21-669c-497d-9364-469eec53967d on hv-cinder-84213 May 26 20:29:10.476535 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-08c0aa29-d70c-4239-b29f-57f931ede068 req-f107f8d6-e2c5-42a5-b781-12071cc1b9b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131576 May 26 20:29:10.477449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 305/606] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:10.650088 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f07362d0-f0ff-4b07-b3e8-ba8f3804c4b4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:10.651419 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f07362d0-f0ff-4b07-b3e8-ba8f3804c4b4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:10.659162 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f07362d0-f0ff-4b07-b3e8-ba8f3804c4b4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:10.659860 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f07362d0-f0ff-4b07-b3e8-ba8f3804c4b4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:10.660644 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f07362d0-f0ff-4b07-b3e8-ba8f3804c4b4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:10.661080 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f07362d0-f0ff-4b07-b3e8-ba8f3804c4b4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:11.040026 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-30971b70-2792-4f7a-af38-3c00480bd296 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:11.043255 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-30971b70-2792-4f7a-af38-3c00480bd296 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:11.051631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-30971b70-2792-4f7a-af38-3c00480bd296 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:11.053187 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-30971b70-2792-4f7a-af38-3c00480bd296 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:11.054205 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-30971b70-2792-4f7a-af38-3c00480bd296 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:11.054889 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-30971b70-2792-4f7a-af38-3c00480bd296 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:11.096488 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f07362d0-f0ff-4b07-b3e8-ba8f3804c4b4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:11.117510 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f07362d0-f0ff-4b07-b3e8-ba8f3804c4b4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1266 microversion: 2.1 time: 0.473574 May 26 20:29:11.122112 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 302/607] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:10 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1266 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:11.146278 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-30971b70-2792-4f7a-af38-3c00480bd296 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:11.154693 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-30971b70-2792-4f7a-af38-3c00480bd296 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 200 len: 1612 microversion: 2.1 time: 0.118999 May 26 20:29:11.155377 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 306/608] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:11 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 1612 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:11.537887 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-123721149", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89de8b4f-17f7-4ec4-b9e8-10249db26cfe"}], "security_groups": [{"name": "tempest-securitygroup--957660237"}], "key_name": "tempest-keypair-1401384039", "user_data": "}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:11.643050 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] validate_networks() for [('89de8b4f-17f7-4ec4-b9e8-10249db26cfe', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:29:12.139327 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6b85ecb6-dda2-4e4c-8b15-4efbd8c43096 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:12.140017 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6b85ecb6-dda2-4e4c-8b15-4efbd8c43096 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:12.147123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6b85ecb6-dda2-4e4c-8b15-4efbd8c43096 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:12.147720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6b85ecb6-dda2-4e4c-8b15-4efbd8c43096 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:12.148573 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6b85ecb6-dda2-4e4c-8b15-4efbd8c43096 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:12.149298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6b85ecb6-dda2-4e4c-8b15-4efbd8c43096 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:12.242704 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:29:12.243183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:29:12.243815 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:29:12.244360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:29:12.244783 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:29:12.255320 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:12.255775 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:12.256807 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:12.262906 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:12.280616 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Getting quotas for project 4df1452f8d474ea9b121f4aef1793af8. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:29:12.286338 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Getting quotas for user 2ecdb952539f401aba5e0f91c3dd8660 and project 4df1452f8d474ea9b121f4aef1793af8. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:29:12.300373 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:29:12.302493 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6b85ecb6-dda2-4e4c-8b15-4efbd8c43096 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:12.302877 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:29:12.316475 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6b85ecb6-dda2-4e4c-8b15-4efbd8c43096 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1266 microversion: 2.1 time: 0.182178 May 26 20:29:12.317056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 307/609] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:12 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:12.321703 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-53d0ffd1-85aa-496f-baba-36823ed1bacb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:12.322327 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-53d0ffd1-85aa-496f-baba-36823ed1bacb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:12.329186 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-53d0ffd1-85aa-496f-baba-36823ed1bacb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:12.329558 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-53d0ffd1-85aa-496f-baba-36823ed1bacb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:12.330346 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-53d0ffd1-85aa-496f-baba-36823ed1bacb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:12.330779 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-53d0ffd1-85aa-496f-baba-36823ed1bacb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:12.344743 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-53d0ffd1-85aa-496f-baba-36823ed1bacb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-53d0ffd1-85aa-496f-baba-36823ed1bacb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a HTTP/1.1 May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:29:12.349543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:29:12.350979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:29:12.350979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:29:12.350979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:29:12.350979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:29:12.350979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:29:12.350979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:29:12.350979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:29:12.350979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:29:12.350979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:29:12.350979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:29:12.350979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:29:12.350979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '931728fa-007b-4441-97c1-602ae434cf8a'} May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:29:12.351725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:29:12.353793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:29:12.357911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-53d0ffd1-85aa-496f-baba-36823ed1bacb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 404 to user: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:29:12.357911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-53d0ffd1-85aa-496f-baba-36823ed1bacb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 404 len: 111 microversion: 2.1 time: 0.029902 May 26 20:29:12.357911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 308/610] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:12 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:29:12.357911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9871fe7e-cb2f-4be9-b628-0cdcf59830aa tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '.version_select at 0x7f2da44cd790>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:12.435686 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-dc99aeb2-33a3-4baa-873b-5a21421a8593 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.902113 May 26 20:29:12.436330 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 303/611] 10.222.0.44 () {62 vars in 1187 bytes} [Thu May 26 20:29:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 20:29:12.445901 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9871fe7e-cb2f-4be9-b628-0cdcf59830aa tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-163588007" status: 202 len: 0 microversion: 2.1 time: 0.092969 May 26 20:29:12.446327 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-330c4c16-df3f-4b51-9af3-39dd05777345 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:12.450427 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 309/612] 10.222.0.44 () {58 vars in 1217 bytes} [Thu May 26 20:29:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-163588007 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 20:29:12.450838 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-330c4c16-df3f-4b51-9af3-39dd05777345 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:12.506686 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-be41641b-8a8d-4e13-9a73-bb1630c68fd0 req-5f996a7c-b361-4585-b766-9f4bdb4d0d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931728fa-007b-4441-97c1-602ae434cf8a", "name": "network-vif-deleted", "tag": "2a052563-e94a-47d5-8122-1456154565da"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:12.516366 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-be41641b-8a8d-4e13-9a73-bb1630c68fd0 req-5f996a7c-b361-4585-b766-9f4bdb4d0d2a service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:12.517149 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-be41641b-8a8d-4e13-9a73-bb1630c68fd0 req-5f996a7c-b361-4585-b766-9f4bdb4d0d2a service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:12.526987 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-330c4c16-df3f-4b51-9af3-39dd05777345 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:12.531371 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-be41641b-8a8d-4e13-9a73-bb1630c68fd0 req-5f996a7c-b361-4585-b766-9f4bdb4d0d2a service nova] Creating event network-vif-deleted:2a052563-e94a-47d5-8122-1456154565da for instance 931728fa-007b-4441-97c1-602ae434cf8a on hv-cinder-84213 May 26 20:29:12.537803 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-330c4c16-df3f-4b51-9af3-39dd05777345 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:12.537925 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-be41641b-8a8d-4e13-9a73-bb1630c68fd0 req-5f996a7c-b361-4585-b766-9f4bdb4d0d2a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038875 May 26 20:29:12.538009 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-330c4c16-df3f-4b51-9af3-39dd05777345 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:12.539244 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 310/613] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:12.541706 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-330c4c16-df3f-4b51-9af3-39dd05777345 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1281 microversion: 2.20 time: 0.096738 May 26 20:29:12.542566 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 304/614] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:12 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1281 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:29:13.263306 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:13.267934 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6f675c5b-51d1-45ce-9343-9434cc1b62bb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: .version_select at 0x7f2da4605820>, body: {"keypair": {"name": "tempest-keypair-1718127336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFC/1fmA28616Q75cu3HXno2lMIrgYOTu+OuyDkoVXZztPh8qzG+0xdAzPn3p8lFd9Ejnfs4gPDyb9qVK/SfgqBkg1FNkpJvDtovzAapp3s532P2GJAROXEBsrgDoOEMA=="}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:13.282088 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-6f675c5b-51d1-45ce-9343-9434cc1b62bb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:29:13.285921 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-6f675c5b-51d1-45ce-9343-9434cc1b62bb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for user f57c87dc60754d3aa87a84605c7a6889 and project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:29:13.334357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-04305c77-7892-4b6b-a052-b7e9f0df7ee8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:13.334978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-04305c77-7892-4b6b-a052-b7e9f0df7ee8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:13.342772 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04305c77-7892-4b6b-a052-b7e9f0df7ee8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:13.343229 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04305c77-7892-4b6b-a052-b7e9f0df7ee8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:13.344004 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04305c77-7892-4b6b-a052-b7e9f0df7ee8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:13.344447 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-04305c77-7892-4b6b-a052-b7e9f0df7ee8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:13.375110 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6f675c5b-51d1-45ce-9343-9434cc1b62bb tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113287 May 26 20:29:13.375712 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 311/615] 10.222.0.44 () {60 vars in 1158 bytes} [Thu May 26 20:29:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:13.478298 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-04305c77-7892-4b6b-a052-b7e9f0df7ee8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:13.485896 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-04305c77-7892-4b6b-a052-b7e9f0df7ee8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1266 microversion: 2.1 time: 0.155668 May 26 20:29:13.486533 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 305/616] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:13 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:29:13.561018 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cc32d790-996c-4a7f-a4ab-d17bcf430c4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:13.565986 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-cc32d790-996c-4a7f-a4ab-d17bcf430c4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:13.568065 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cc32d790-996c-4a7f-a4ab-d17bcf430c4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:13.568507 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cc32d790-996c-4a7f-a4ab-d17bcf430c4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:13.569253 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cc32d790-996c-4a7f-a4ab-d17bcf430c4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:13.569685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cc32d790-996c-4a7f-a4ab-d17bcf430c4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:13.633542 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cc32d790-996c-4a7f-a4ab-d17bcf430c4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:13.643317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cc32d790-996c-4a7f-a4ab-d17bcf430c4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:13.644828 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cc32d790-996c-4a7f-a4ab-d17bcf430c4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:13.645952 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-cc32d790-996c-4a7f-a4ab-d17bcf430c4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1285 microversion: 2.20 time: 0.089674 May 26 20:29:13.647130 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 312/617] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:13 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:29:14.503431 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-74605321-2a09-48b9-b285-7eca28d29196 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:14.503994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-74605321-2a09-48b9-b285-7eca28d29196 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:14.510928 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-74605321-2a09-48b9-b285-7eca28d29196 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:14.511387 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-74605321-2a09-48b9-b285-7eca28d29196 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:14.512192 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-74605321-2a09-48b9-b285-7eca28d29196 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:14.512626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-74605321-2a09-48b9-b285-7eca28d29196 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:14.663880 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-653e2e7c-1088-431c-b81a-79976bad663c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:14.665135 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-653e2e7c-1088-431c-b81a-79976bad663c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:14.672258 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-653e2e7c-1088-431c-b81a-79976bad663c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:14.672709 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-653e2e7c-1088-431c-b81a-79976bad663c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:14.674524 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-653e2e7c-1088-431c-b81a-79976bad663c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:14.674524 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-653e2e7c-1088-431c-b81a-79976bad663c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:14.743283 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-74605321-2a09-48b9-b285-7eca28d29196 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:14.750365 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-653e2e7c-1088-431c-b81a-79976bad663c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:14.753262 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-74605321-2a09-48b9-b285-7eca28d29196 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1266 microversion: 2.1 time: 0.253629 May 26 20:29:14.754129 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 306/618] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:14 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:14.767550 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-653e2e7c-1088-431c-b81a-79976bad663c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:14.769351 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-653e2e7c-1088-431c-b81a-79976bad663c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:14.770883 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-653e2e7c-1088-431c-b81a-79976bad663c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1341 microversion: 2.20 time: 0.110872 May 26 20:29:14.771702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 313/619] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:14 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1341 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:29:15.722813 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1507317250", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d8f9587-b15f-4a25-9b7c-c72960c971d6"}], "security_groups": [{"name": "tempest-securitygroup--851973306"}], "key_name": "tempest-keypair-1718127336", "user_data": "}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:15.771153 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b73bc92d-3ecb-4a9c-9690-3fb052537e77 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:15.772040 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b73bc92d-3ecb-4a9c-9690-3fb052537e77 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:15.781367 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b73bc92d-3ecb-4a9c-9690-3fb052537e77 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:15.782001 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b73bc92d-3ecb-4a9c-9690-3fb052537e77 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:15.784192 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b73bc92d-3ecb-4a9c-9690-3fb052537e77 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:15.784942 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b73bc92d-3ecb-4a9c-9690-3fb052537e77 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:15.869287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] validate_networks() for [('0d8f9587-b15f-4a25-9b7c-c72960c971d6', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:29:15.928606 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b73bc92d-3ecb-4a9c-9690-3fb052537e77 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:15.936829 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b73bc92d-3ecb-4a9c-9690-3fb052537e77 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1266 microversion: 2.1 time: 0.170068 May 26 20:29:15.937410 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 314/620] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:15 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:15.941881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-654c571b-65a5-408e-941d-5db8688a6294 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:15.942954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-654c571b-65a5-408e-941d-5db8688a6294 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:15.948708 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-654c571b-65a5-408e-941d-5db8688a6294 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:15.949760 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-654c571b-65a5-408e-941d-5db8688a6294 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:15.952664 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-654c571b-65a5-408e-941d-5db8688a6294 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:15.952664 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-654c571b-65a5-408e-941d-5db8688a6294 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:16.087824 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-654c571b-65a5-408e-941d-5db8688a6294 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:16.096750 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-654c571b-65a5-408e-941d-5db8688a6294 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:16.102139 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-654c571b-65a5-408e-941d-5db8688a6294 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:16.102139 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-654c571b-65a5-408e-941d-5db8688a6294 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1406 microversion: 2.20 time: 0.161065 May 26 20:29:16.102139 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 315/621] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:15 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:29:16.507329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:29:16.507763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:29:16.508242 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:29:16.508651 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:29:16.509064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:29:16.517918 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:16.518471 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:16.519273 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:16.519713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:16.536392 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:29:16.540231 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Getting quotas for user f57c87dc60754d3aa87a84605c7a6889 and project c09dea310ad24870bc5f20241f7f1ad7. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:29:16.551441 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:29:16.553536 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:29:16.649874 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-d477104f-1406-4b05-a90a-a9b4d268276f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:16.651302 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-d477104f-1406-4b05-a90a-a9b4d268276f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:16.658799 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d477104f-1406-4b05-a90a-a9b4d268276f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:16.659496 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d477104f-1406-4b05-a90a-a9b4d268276f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:16.660676 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d477104f-1406-4b05-a90a-a9b4d268276f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:16.661176 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d477104f-1406-4b05-a90a-a9b4d268276f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:16.666447 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:16.699969 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-dd02375d-0a57-46d1-94c2-f487fc8b1364 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.980308 May 26 20:29:16.701368 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 307/622] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:29:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:29:16.712625 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-55053c71-50ca-4586-be31-a2f36dbe05dc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:16.713996 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-55053c71-50ca-4586-be31-a2f36dbe05dc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:16.807298 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-55053c71-50ca-4586-be31-a2f36dbe05dc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:16.818572 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-55053c71-50ca-4586-be31-a2f36dbe05dc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1242 microversion: 2.1 time: 0.110714 May 26 20:29:16.828027 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 308/623] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:16 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:16.960955 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-25a6e867-72a5-436b-88f8-19a046028fc2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:16.960955 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-25a6e867-72a5-436b-88f8-19a046028fc2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:16.961177 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-d477104f-1406-4b05-a90a-a9b4d268276f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "POST /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/action" status: 202 len: 0 microversion: 2.1 time: 0.313248 May 26 20:29:16.961177 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 316/624] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:29:16 2022] POST /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 20:29:16.970369 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25a6e867-72a5-436b-88f8-19a046028fc2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:16.970910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25a6e867-72a5-436b-88f8-19a046028fc2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:16.971839 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25a6e867-72a5-436b-88f8-19a046028fc2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:16.972344 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-25a6e867-72a5-436b-88f8-19a046028fc2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:16.988547 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-65ce1eed-f37a-4e16-ad25-669fc7e3a84c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:16.998436 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-65ce1eed-f37a-4e16-ad25-669fc7e3a84c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:16.999683 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-65ce1eed-f37a-4e16-ad25-669fc7e3a84c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:17.000305 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-65ce1eed-f37a-4e16-ad25-669fc7e3a84c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:17.001267 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-65ce1eed-f37a-4e16-ad25-669fc7e3a84c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:17.001871 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-65ce1eed-f37a-4e16-ad25-669fc7e3a84c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:17.150033 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-25a6e867-72a5-436b-88f8-19a046028fc2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:17.159626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-25a6e867-72a5-436b-88f8-19a046028fc2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1266 microversion: 2.1 time: 0.210528 May 26 20:29:17.171057 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 309/625] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:16 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:29:17.177562 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-07b334ef-fb12-47fd-bc3c-dd07c65a1844 req-421c7a08-3ea7-4a7d-b219-0cd6e135b4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "419dd0d9-334f-4481-aa27-8c24115614db", "tag": "9ff1ecd8-c0e6-4014-b5c2-850b82d549df"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:17.183094 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-65ce1eed-f37a-4e16-ad25-669fc7e3a84c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:17.188919 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-07b334ef-fb12-47fd-bc3c-dd07c65a1844 req-421c7a08-3ea7-4a7d-b219-0cd6e135b4ff service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:17.189824 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-07b334ef-fb12-47fd-bc3c-dd07c65a1844 req-421c7a08-3ea7-4a7d-b219-0cd6e135b4ff service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:17.194199 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-65ce1eed-f37a-4e16-ad25-669fc7e3a84c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1751 microversion: 2.1 time: 0.225765 May 26 20:29:17.194887 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 317/626] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:16 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1751 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:17.201051 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-31b83380-c3aa-495b-a95d-1645655087f3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:17.201785 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-31b83380-c3aa-495b-a95d-1645655087f3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:17.202965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-07b334ef-fb12-47fd-bc3c-dd07c65a1844 req-421c7a08-3ea7-4a7d-b219-0cd6e135b4ff service nova] Creating event network-changed:9ff1ecd8-c0e6-4014-b5c2-850b82d549df for instance 419dd0d9-334f-4481-aa27-8c24115614db on hv-cinder-84213 May 26 20:29:17.207961 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-07b334ef-fb12-47fd-bc3c-dd07c65a1844 req-421c7a08-3ea7-4a7d-b219-0cd6e135b4ff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035233 May 26 20:29:17.208093 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-31b83380-c3aa-495b-a95d-1645655087f3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:17.208550 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-31b83380-c3aa-495b-a95d-1645655087f3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:17.209303 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 310/627] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:17.209459 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-31b83380-c3aa-495b-a95d-1645655087f3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:17.209942 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-31b83380-c3aa-495b-a95d-1645655087f3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:17.347472 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-31b83380-c3aa-495b-a95d-1645655087f3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:17.354514 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-31b83380-c3aa-495b-a95d-1645655087f3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:17.357000 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-31b83380-c3aa-495b-a95d-1645655087f3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:17.358127 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-31b83380-c3aa-495b-a95d-1645655087f3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1406 microversion: 2.20 time: 0.162308 May 26 20:29:17.358893 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 318/628] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:17 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:29:17.836159 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a938ba47-5192-4b66-ad78-d365eed29868 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:17.836857 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a938ba47-5192-4b66-ad78-d365eed29868 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:17.843854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a938ba47-5192-4b66-ad78-d365eed29868 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:17.844301 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a938ba47-5192-4b66-ad78-d365eed29868 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:17.845059 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a938ba47-5192-4b66-ad78-d365eed29868 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:17.845492 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a938ba47-5192-4b66-ad78-d365eed29868 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:17.945973 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a938ba47-5192-4b66-ad78-d365eed29868 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:17.953720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a938ba47-5192-4b66-ad78-d365eed29868 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1246 microversion: 2.1 time: 0.121659 May 26 20:29:17.954557 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 311/629] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:17 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1246 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:18.178841 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-68577e57-3012-4057-9b0c-98e1252e668a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:18.181178 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-68577e57-3012-4057-9b0c-98e1252e668a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:18.200442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-68577e57-3012-4057-9b0c-98e1252e668a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:18.201507 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-68577e57-3012-4057-9b0c-98e1252e668a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:18.202642 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-68577e57-3012-4057-9b0c-98e1252e668a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:18.203267 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-68577e57-3012-4057-9b0c-98e1252e668a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:18.219646 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d632d5bf-977c-4666-b61b-ff391a94cfa8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:18.220586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d632d5bf-977c-4666-b61b-ff391a94cfa8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:18.227726 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d632d5bf-977c-4666-b61b-ff391a94cfa8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:18.228328 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d632d5bf-977c-4666-b61b-ff391a94cfa8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:18.229211 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d632d5bf-977c-4666-b61b-ff391a94cfa8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:18.229887 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d632d5bf-977c-4666-b61b-ff391a94cfa8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:18.393027 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-68577e57-3012-4057-9b0c-98e1252e668a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:18.402877 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-68577e57-3012-4057-9b0c-98e1252e668a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1266 microversion: 2.1 time: 0.227203 May 26 20:29:18.405796 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 319/630] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:18 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:18.409025 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b0363849-6ecb-40a0-86e3-ebde4c4d1e8f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:18.409622 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b0363849-6ecb-40a0-86e3-ebde4c4d1e8f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:18.416316 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b0363849-6ecb-40a0-86e3-ebde4c4d1e8f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:18.416757 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b0363849-6ecb-40a0-86e3-ebde4c4d1e8f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:18.418449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b0363849-6ecb-40a0-86e3-ebde4c4d1e8f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:18.418886 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b0363849-6ecb-40a0-86e3-ebde4c4d1e8f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:18.546836 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-d632d5bf-977c-4666-b61b-ff391a94cfa8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:18.557170 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d632d5bf-977c-4666-b61b-ff391a94cfa8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1751 microversion: 2.1 time: 0.344160 May 26 20:29:18.557767 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 312/631] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:18 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1751 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:29:18.775324 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b0363849-6ecb-40a0-86e3-ebde4c4d1e8f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:18.783810 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b0363849-6ecb-40a0-86e3-ebde4c4d1e8f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:18.785263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b0363849-6ecb-40a0-86e3-ebde4c4d1e8f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:18.786407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b0363849-6ecb-40a0-86e3-ebde4c4d1e8f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1406 microversion: 2.20 time: 0.381418 May 26 20:29:18.786964 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 320/632] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:18 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:29:18.970908 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1819e15b-f546-42fc-b4e3-ee3e5ed4b58e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:18.971515 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1819e15b-f546-42fc-b4e3-ee3e5ed4b58e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:18.977928 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1819e15b-f546-42fc-b4e3-ee3e5ed4b58e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:18.978412 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1819e15b-f546-42fc-b4e3-ee3e5ed4b58e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:18.979164 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1819e15b-f546-42fc-b4e3-ee3e5ed4b58e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:18.979590 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1819e15b-f546-42fc-b4e3-ee3e5ed4b58e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:19.041471 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-1819e15b-f546-42fc-b4e3-ee3e5ed4b58e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:19.049001 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1819e15b-f546-42fc-b4e3-ee3e5ed4b58e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1294 microversion: 2.1 time: 0.081947 May 26 20:29:19.049591 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 313/633] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:18 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:19.420770 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-12f57575-4599-4bf0-9bc6-abdb6216d413 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:19.421414 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-12f57575-4599-4bf0-9bc6-abdb6216d413 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:19.428031 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12f57575-4599-4bf0-9bc6-abdb6216d413 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:19.428477 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12f57575-4599-4bf0-9bc6-abdb6216d413 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:19.429244 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12f57575-4599-4bf0-9bc6-abdb6216d413 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:19.429679 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12f57575-4599-4bf0-9bc6-abdb6216d413 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:19.573837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f902e9a8-5abd-4352-9621-ac5d95821912 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:19.574934 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f902e9a8-5abd-4352-9621-ac5d95821912 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:19.578488 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-12f57575-4599-4bf0-9bc6-abdb6216d413 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:19.587519 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f902e9a8-5abd-4352-9621-ac5d95821912 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:19.588092 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f902e9a8-5abd-4352-9621-ac5d95821912 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:19.588223 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-12f57575-4599-4bf0-9bc6-abdb6216d413 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1266 microversion: 2.1 time: 0.171541 May 26 20:29:19.594296 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f902e9a8-5abd-4352-9621-ac5d95821912 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:19.594473 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 321/634] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:19 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:19.600777 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f902e9a8-5abd-4352-9621-ac5d95821912 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:19.806966 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1b0971c4-05ea-4c97-a93d-a0b2112d012b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:19.807595 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-1b0971c4-05ea-4c97-a93d-a0b2112d012b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:19.814321 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1b0971c4-05ea-4c97-a93d-a0b2112d012b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:19.814749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1b0971c4-05ea-4c97-a93d-a0b2112d012b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:19.815519 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1b0971c4-05ea-4c97-a93d-a0b2112d012b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:19.815954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1b0971c4-05ea-4c97-a93d-a0b2112d012b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:19.896092 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f902e9a8-5abd-4352-9621-ac5d95821912 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:19.907735 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f902e9a8-5abd-4352-9621-ac5d95821912 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1751 microversion: 2.1 time: 0.337665 May 26 20:29:19.918556 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 314/635] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:19 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1751 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:19.978679 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1b0971c4-05ea-4c97-a93d-a0b2112d012b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:19.987528 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1b0971c4-05ea-4c97-a93d-a0b2112d012b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:19.989029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1b0971c4-05ea-4c97-a93d-a0b2112d012b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:19.990170 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1b0971c4-05ea-4c97-a93d-a0b2112d012b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1406 microversion: 2.20 time: 0.189466 May 26 20:29:19.990784 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 322/636] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:19 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:29:20.067698 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4d99caaf-a00c-48fa-af40-86927dc8d467 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:20.068409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4d99caaf-a00c-48fa-af40-86927dc8d467 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:20.076670 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d99caaf-a00c-48fa-af40-86927dc8d467 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:20.077413 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d99caaf-a00c-48fa-af40-86927dc8d467 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:20.078542 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d99caaf-a00c-48fa-af40-86927dc8d467 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:20.079178 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d99caaf-a00c-48fa-af40-86927dc8d467 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:20.225502 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-4d99caaf-a00c-48fa-af40-86927dc8d467 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:20.233471 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4d99caaf-a00c-48fa-af40-86927dc8d467 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1312 microversion: 2.1 time: 0.169999 May 26 20:29:20.234279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 315/637] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:20 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:20.606517 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7f7fb3cc-034b-4657-93b8-e1c08450d542 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:20.607758 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7f7fb3cc-034b-4657-93b8-e1c08450d542 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:20.614336 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7f7fb3cc-034b-4657-93b8-e1c08450d542 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:20.614790 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7f7fb3cc-034b-4657-93b8-e1c08450d542 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:20.615554 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7f7fb3cc-034b-4657-93b8-e1c08450d542 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:20.615984 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7f7fb3cc-034b-4657-93b8-e1c08450d542 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:20.749878 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7f7fb3cc-034b-4657-93b8-e1c08450d542 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:20.757290 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7f7fb3cc-034b-4657-93b8-e1c08450d542 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1266 microversion: 2.1 time: 0.154735 May 26 20:29:20.757891 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 323/638] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:20 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:20.925026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9458a705-9da9-4535-9031-f6bebd93457b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:20.925926 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9458a705-9da9-4535-9031-f6bebd93457b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:20.932319 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9458a705-9da9-4535-9031-f6bebd93457b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:20.932785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9458a705-9da9-4535-9031-f6bebd93457b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:20.934354 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9458a705-9da9-4535-9031-f6bebd93457b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:20.935019 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9458a705-9da9-4535-9031-f6bebd93457b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:21.008440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-53b5dd12-8b66-4ac9-b4ec-3e28389d5e59 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:21.009049 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-53b5dd12-8b66-4ac9-b4ec-3e28389d5e59 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:21.015119 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-53b5dd12-8b66-4ac9-b4ec-3e28389d5e59 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:21.015761 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-53b5dd12-8b66-4ac9-b4ec-3e28389d5e59 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:21.016647 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-53b5dd12-8b66-4ac9-b4ec-3e28389d5e59 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:21.016946 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-53b5dd12-8b66-4ac9-b4ec-3e28389d5e59 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:21.155701 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-53b5dd12-8b66-4ac9-b4ec-3e28389d5e59 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:21.164414 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-53b5dd12-8b66-4ac9-b4ec-3e28389d5e59 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:21.165920 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-53b5dd12-8b66-4ac9-b4ec-3e28389d5e59 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:21.167106 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-53b5dd12-8b66-4ac9-b4ec-3e28389d5e59 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1406 microversion: 2.20 time: 0.162929 May 26 20:29:21.168466 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 324/639] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:21 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:29:21.203410 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9458a705-9da9-4535-9031-f6bebd93457b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:21.212878 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9458a705-9da9-4535-9031-f6bebd93457b tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.291934 May 26 20:29:21.213828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 316/640] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:20 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:21.251064 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-32f09086-efb6-4ce1-b572-c9c98a3e9d3b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:21.251907 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-32f09086-efb6-4ce1-b572-c9c98a3e9d3b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:21.255105 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:21.258693 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-32f09086-efb6-4ce1-b572-c9c98a3e9d3b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:21.259227 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-32f09086-efb6-4ce1-b572-c9c98a3e9d3b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:21.260046 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-32f09086-efb6-4ce1-b572-c9c98a3e9d3b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:21.260664 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-32f09086-efb6-4ce1-b572-c9c98a3e9d3b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:21.406618 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-32f09086-efb6-4ce1-b572-c9c98a3e9d3b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:21.414286 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-32f09086-efb6-4ce1-b572-c9c98a3e9d3b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1367 microversion: 2.1 time: 0.167279 May 26 20:29:21.414851 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 325/641] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:21 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:21.481974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-f509cd9a-4c0c-452e-8df9-2e8c847aff56 req-53e8d471-66ad-415e-9d0c-770468385f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39113a21-669c-497d-9364-469eec53967d", "name": "network-vif-plugged", "status": "completed", "tag": "b712f1a3-a312-49b0-b2f0-18cd232d399a"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:21.486233 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:21.491897 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f509cd9a-4c0c-452e-8df9-2e8c847aff56 req-53e8d471-66ad-415e-9d0c-770468385f22 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:21.492474 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f509cd9a-4c0c-452e-8df9-2e8c847aff56 req-53e8d471-66ad-415e-9d0c-770468385f22 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:21.496484 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:21.505541 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-f509cd9a-4c0c-452e-8df9-2e8c847aff56 req-53e8d471-66ad-415e-9d0c-770468385f22 service nova] Creating event network-vif-plugged:b712f1a3-a312-49b0-b2f0-18cd232d399a for instance 39113a21-669c-497d-9364-469eec53967d on hv-cinder-84213 May 26 20:29:21.516667 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-f509cd9a-4c0c-452e-8df9-2e8c847aff56 req-53e8d471-66ad-415e-9d0c-770468385f22 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090765 May 26 20:29:21.516667 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 317/642] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:21.773710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-bf41ead1-144b-478b-9b42-250fb6f8d6ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:21.775225 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-bf41ead1-144b-478b-9b42-250fb6f8d6ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:21.784462 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bf41ead1-144b-478b-9b42-250fb6f8d6ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:21.785328 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bf41ead1-144b-478b-9b42-250fb6f8d6ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:21.786204 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bf41ead1-144b-478b-9b42-250fb6f8d6ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:21.787189 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bf41ead1-144b-478b-9b42-250fb6f8d6ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:21.828465 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-903099b9-5cce-4d14-a948-bd1d042625f5 req-338418c7-daed-4f03-9493-294e094df8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6565432e-8214-4e00-84ca-525f7acc6c8c", "tag": "e69ae7b9-16d9-473a-85f4-968fc5e64a24"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:21.854607 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-903099b9-5cce-4d14-a948-bd1d042625f5 req-338418c7-daed-4f03-9493-294e094df8de service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:21.857937 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-903099b9-5cce-4d14-a948-bd1d042625f5 req-338418c7-daed-4f03-9493-294e094df8de service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:21.877061 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-903099b9-5cce-4d14-a948-bd1d042625f5 req-338418c7-daed-4f03-9493-294e094df8de service nova] Creating event network-changed:e69ae7b9-16d9-473a-85f4-968fc5e64a24 for instance 6565432e-8214-4e00-84ca-525f7acc6c8c on hv-cinder-84213 May 26 20:29:21.881797 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-903099b9-5cce-4d14-a948-bd1d042625f5 req-338418c7-daed-4f03-9493-294e094df8de service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058919 May 26 20:29:21.882765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 318/643] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:29:21.967762 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-bf41ead1-144b-478b-9b42-250fb6f8d6ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:21.975485 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-bf41ead1-144b-478b-9b42-250fb6f8d6ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1266 microversion: 2.1 time: 0.205869 May 26 20:29:21.976054 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 326/644] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:21 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:22.188207 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f7268a35-8e4d-49b0-bfe3-4807cf051178 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:22.188900 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f7268a35-8e4d-49b0-bfe3-4807cf051178 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:22.196129 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f7268a35-8e4d-49b0-bfe3-4807cf051178 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:22.197175 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f7268a35-8e4d-49b0-bfe3-4807cf051178 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:22.197971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f7268a35-8e4d-49b0-bfe3-4807cf051178 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:22.198476 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f7268a35-8e4d-49b0-bfe3-4807cf051178 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:22.231287 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a4f83257-78ac-4887-a080-8ee80e9826c4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:22.231906 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a4f83257-78ac-4887-a080-8ee80e9826c4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:22.237973 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a4f83257-78ac-4887-a080-8ee80e9826c4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:22.238461 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a4f83257-78ac-4887-a080-8ee80e9826c4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:22.239234 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a4f83257-78ac-4887-a080-8ee80e9826c4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:22.239727 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a4f83257-78ac-4887-a080-8ee80e9826c4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:22.349885 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f7268a35-8e4d-49b0-bfe3-4807cf051178 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:22.359310 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f7268a35-8e4d-49b0-bfe3-4807cf051178 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:22.360725 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f7268a35-8e4d-49b0-bfe3-4807cf051178 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:22.361835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f7268a35-8e4d-49b0-bfe3-4807cf051178 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1406 microversion: 2.20 time: 0.180577 May 26 20:29:22.362415 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 319/645] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:22 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:29:22.386117 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a4f83257-78ac-4887-a080-8ee80e9826c4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:22.394403 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a4f83257-78ac-4887-a080-8ee80e9826c4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.167727 May 26 20:29:22.394989 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 327/646] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:22 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:29:22.432122 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-545d59fa-abfd-4575-bcde-58dc89b91c12 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:22.432730 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-545d59fa-abfd-4575-bcde-58dc89b91c12 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:22.440651 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-545d59fa-abfd-4575-bcde-58dc89b91c12 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:22.441102 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-545d59fa-abfd-4575-bcde-58dc89b91c12 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:22.441924 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-545d59fa-abfd-4575-bcde-58dc89b91c12 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:22.442391 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-545d59fa-abfd-4575-bcde-58dc89b91c12 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:22.756958 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-545d59fa-abfd-4575-bcde-58dc89b91c12 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:22.764416 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-545d59fa-abfd-4575-bcde-58dc89b91c12 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1367 microversion: 2.1 time: 0.336197 May 26 20:29:22.764989 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 320/647] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:22 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:22.991781 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9936b17b-22b5-4ce9-af95-68d4dcb5c582 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:22.992424 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9936b17b-22b5-4ce9-af95-68d4dcb5c582 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:22.999473 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9936b17b-22b5-4ce9-af95-68d4dcb5c582 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:22.999929 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9936b17b-22b5-4ce9-af95-68d4dcb5c582 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:23.000705 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9936b17b-22b5-4ce9-af95-68d4dcb5c582 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:23.001285 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9936b17b-22b5-4ce9-af95-68d4dcb5c582 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:23.138738 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9936b17b-22b5-4ce9-af95-68d4dcb5c582 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:23.147940 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9936b17b-22b5-4ce9-af95-68d4dcb5c582 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1266 microversion: 2.1 time: 0.160005 May 26 20:29:23.148772 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 328/648] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:22 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:23.383399 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a86d8eb2-d7bc-4da7-a74f-4600ac248440 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:23.384012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a86d8eb2-d7bc-4da7-a74f-4600ac248440 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:23.392653 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a86d8eb2-d7bc-4da7-a74f-4600ac248440 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:23.392653 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a86d8eb2-d7bc-4da7-a74f-4600ac248440 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:23.395351 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a86d8eb2-d7bc-4da7-a74f-4600ac248440 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:23.395351 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a86d8eb2-d7bc-4da7-a74f-4600ac248440 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:23.411574 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-23610134-54ec-4503-b755-cc4583ab3952 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:23.412188 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-23610134-54ec-4503-b755-cc4583ab3952 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:23.414140 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=12 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:23.418987 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-23610134-54ec-4503-b755-cc4583ab3952 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:23.420410 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-23610134-54ec-4503-b755-cc4583ab3952 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:23.420410 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-23610134-54ec-4503-b755-cc4583ab3952 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:23.420776 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-23610134-54ec-4503-b755-cc4583ab3952 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:23.529999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a86d8eb2-d7bc-4da7-a74f-4600ac248440 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:23.538199 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a86d8eb2-d7bc-4da7-a74f-4600ac248440 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:23.539743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a86d8eb2-d7bc-4da7-a74f-4600ac248440 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:23.540875 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a86d8eb2-d7bc-4da7-a74f-4600ac248440 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1406 microversion: 2.20 time: 0.161374 May 26 20:29:23.541507 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 321/649] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:23 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:29:23.550002 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-bd7241f1-9eab-4d4b-a758-717b32ce6550 req-86afb266-f5b1-4de6-8651-226bb34c8aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419dd0d9-334f-4481-aa27-8c24115614db", "name": "network-vif-plugged", "status": "completed", "tag": "9ff1ecd8-c0e6-4014-b5c2-850b82d549df"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:23.560554 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-bd7241f1-9eab-4d4b-a758-717b32ce6550 req-86afb266-f5b1-4de6-8651-226bb34c8aca service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:23.561070 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-bd7241f1-9eab-4d4b-a758-717b32ce6550 req-86afb266-f5b1-4de6-8651-226bb34c8aca service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:23.572394 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-bd7241f1-9eab-4d4b-a758-717b32ce6550 req-86afb266-f5b1-4de6-8651-226bb34c8aca service nova] Creating event network-vif-plugged:9ff1ecd8-c0e6-4014-b5c2-850b82d549df for instance 419dd0d9-334f-4481-aa27-8c24115614db on hv-cinder-84213 May 26 20:29:23.575515 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-23610134-54ec-4503-b755-cc4583ab3952 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:23.580205 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-bd7241f1-9eab-4d4b-a758-717b32ce6550 req-86afb266-f5b1-4de6-8651-226bb34c8aca service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032719 May 26 20:29:23.580205 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 322/650] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:23.585163 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-23610134-54ec-4503-b755-cc4583ab3952 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.177310 May 26 20:29:23.585737 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 329/651] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:23 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:29:23.782000 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b8ec8c94-a2bd-430d-b6b4-17f4a1105665 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:23.782841 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b8ec8c94-a2bd-430d-b6b4-17f4a1105665 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:23.789287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b8ec8c94-a2bd-430d-b6b4-17f4a1105665 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:23.789793 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b8ec8c94-a2bd-430d-b6b4-17f4a1105665 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:23.790598 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b8ec8c94-a2bd-430d-b6b4-17f4a1105665 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:23.791040 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b8ec8c94-a2bd-430d-b6b4-17f4a1105665 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:23.925701 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b8ec8c94-a2bd-430d-b6b4-17f4a1105665 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:23.933436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b8ec8c94-a2bd-430d-b6b4-17f4a1105665 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1367 microversion: 2.1 time: 0.155945 May 26 20:29:23.934044 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 323/652] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:23 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:24.164837 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-3687c9bd-6447-4265-910a-38cf29118b7b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:24.165440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3687c9bd-6447-4265-910a-38cf29118b7b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:24.173021 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3687c9bd-6447-4265-910a-38cf29118b7b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:24.173468 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3687c9bd-6447-4265-910a-38cf29118b7b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:24.174219 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3687c9bd-6447-4265-910a-38cf29118b7b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:24.174669 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3687c9bd-6447-4265-910a-38cf29118b7b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:24.307193 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-3687c9bd-6447-4265-910a-38cf29118b7b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:24.314813 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-3687c9bd-6447-4265-910a-38cf29118b7b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1453 microversion: 2.1 time: 0.153799 May 26 20:29:24.315378 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 330/653] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:24 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:24.330854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-14ae44f8-f8e2-4bc5-8be4-f3afccf1dd18 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:24.331468 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-14ae44f8-f8e2-4bc5-8be4-f3afccf1dd18 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:24.337416 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-14ae44f8-f8e2-4bc5-8be4-f3afccf1dd18 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:24.337865 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-14ae44f8-f8e2-4bc5-8be4-f3afccf1dd18 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:24.338662 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-14ae44f8-f8e2-4bc5-8be4-f3afccf1dd18 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:24.339101 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-14ae44f8-f8e2-4bc5-8be4-f3afccf1dd18 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:24.469585 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-14ae44f8-f8e2-4bc5-8be4-f3afccf1dd18 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:24.477024 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-14ae44f8-f8e2-4bc5-8be4-f3afccf1dd18 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1453 microversion: 2.1 time: 0.149985 May 26 20:29:24.477585 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 324/654] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:24 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:24.559025 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6b3d5d85-997c-4fef-9897-e01a716285a9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:24.559785 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6b3d5d85-997c-4fef-9897-e01a716285a9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:24.565635 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6b3d5d85-997c-4fef-9897-e01a716285a9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:24.566078 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6b3d5d85-997c-4fef-9897-e01a716285a9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:24.566860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6b3d5d85-997c-4fef-9897-e01a716285a9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:24.567287 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6b3d5d85-997c-4fef-9897-e01a716285a9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:24.607679 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a6b4facb-5de6-4d4e-9a6a-859f3d3623e4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:24.608297 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a6b4facb-5de6-4d4e-9a6a-859f3d3623e4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:24.614834 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a6b4facb-5de6-4d4e-9a6a-859f3d3623e4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:24.615291 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a6b4facb-5de6-4d4e-9a6a-859f3d3623e4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:24.616067 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a6b4facb-5de6-4d4e-9a6a-859f3d3623e4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:24.616508 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a6b4facb-5de6-4d4e-9a6a-859f3d3623e4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:24.739492 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6b3d5d85-997c-4fef-9897-e01a716285a9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:24.742878 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:24.747877 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6b3d5d85-997c-4fef-9897-e01a716285a9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:24.749404 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6b3d5d85-997c-4fef-9897-e01a716285a9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:24.750534 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6b3d5d85-997c-4fef-9897-e01a716285a9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1406 microversion: 2.20 time: 0.195483 May 26 20:29:24.756424 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 331/655] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:24 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:29:24.826395 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a6b4facb-5de6-4d4e-9a6a-859f3d3623e4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:24.834381 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a6b4facb-5de6-4d4e-9a6a-859f3d3623e4 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.231304 May 26 20:29:24.834957 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 325/656] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:24 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:29:24.952043 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-50085eb1-3a34-4dfe-beab-3c093ee367b6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:24.952659 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-50085eb1-3a34-4dfe-beab-3c093ee367b6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:24.959370 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-50085eb1-3a34-4dfe-beab-3c093ee367b6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:24.963220 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-50085eb1-3a34-4dfe-beab-3c093ee367b6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:24.963220 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-50085eb1-3a34-4dfe-beab-3c093ee367b6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:24.963220 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-50085eb1-3a34-4dfe-beab-3c093ee367b6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:25.174326 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-50085eb1-3a34-4dfe-beab-3c093ee367b6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:25.181795 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-50085eb1-3a34-4dfe-beab-3c093ee367b6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1367 microversion: 2.1 time: 0.234389 May 26 20:29:25.182400 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 332/657] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:24 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:25.768760 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-59766acb-dcf7-46e6-a227-06d257b34f92 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:25.769378 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-59766acb-dcf7-46e6-a227-06d257b34f92 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:25.775890 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-59766acb-dcf7-46e6-a227-06d257b34f92 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:25.786203 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-59766acb-dcf7-46e6-a227-06d257b34f92 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:25.786203 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-59766acb-dcf7-46e6-a227-06d257b34f92 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:25.786203 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-59766acb-dcf7-46e6-a227-06d257b34f92 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:25.852331 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-d5f074ff-972f-41cb-a877-64585a9c9d21 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:25.853078 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-d5f074ff-972f-41cb-a877-64585a9c9d21 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:25.860359 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d5f074ff-972f-41cb-a877-64585a9c9d21 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:25.861149 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d5f074ff-972f-41cb-a877-64585a9c9d21 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:25.861623 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d5f074ff-972f-41cb-a877-64585a9c9d21 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:25.862104 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d5f074ff-972f-41cb-a877-64585a9c9d21 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:25.915948 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-59766acb-dcf7-46e6-a227-06d257b34f92 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:25.925112 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-59766acb-dcf7-46e6-a227-06d257b34f92 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:25.927434 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-59766acb-dcf7-46e6-a227-06d257b34f92 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:25.928665 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-59766acb-dcf7-46e6-a227-06d257b34f92 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1406 microversion: 2.20 time: 0.163917 May 26 20:29:25.929333 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 326/658] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:25 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:29:26.093932 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-d5f074ff-972f-41cb-a877-64585a9c9d21 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:26.101943 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-d5f074ff-972f-41cb-a877-64585a9c9d21 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.253561 May 26 20:29:26.102558 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 333/659] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:25 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:29:26.200654 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5dc63a78-5d6b-4fce-8b90-358a64dfecbc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:26.205401 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5dc63a78-5d6b-4fce-8b90-358a64dfecbc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:26.208793 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5dc63a78-5d6b-4fce-8b90-358a64dfecbc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:26.209243 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5dc63a78-5d6b-4fce-8b90-358a64dfecbc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:26.210935 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5dc63a78-5d6b-4fce-8b90-358a64dfecbc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:26.210935 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5dc63a78-5d6b-4fce-8b90-358a64dfecbc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:26.355186 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5dc63a78-5d6b-4fce-8b90-358a64dfecbc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:26.362615 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5dc63a78-5d6b-4fce-8b90-358a64dfecbc tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1367 microversion: 2.1 time: 0.166332 May 26 20:29:26.363187 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 327/660] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:26 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:26.840555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-0645c0f7-6f79-4a06-ad1f-47a59ac950a5 req-6e4c8ceb-a6ca-4444-b953-bf5de3eabfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39113a21-669c-497d-9364-469eec53967d", "tag": "b712f1a3-a312-49b0-b2f0-18cd232d399a"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:26.848951 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-0645c0f7-6f79-4a06-ad1f-47a59ac950a5 req-6e4c8ceb-a6ca-4444-b953-bf5de3eabfc8 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:26.849393 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-0645c0f7-6f79-4a06-ad1f-47a59ac950a5 req-6e4c8ceb-a6ca-4444-b953-bf5de3eabfc8 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:26.862201 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-0645c0f7-6f79-4a06-ad1f-47a59ac950a5 req-6e4c8ceb-a6ca-4444-b953-bf5de3eabfc8 service nova] Creating event network-changed:b712f1a3-a312-49b0-b2f0-18cd232d399a for instance 39113a21-669c-497d-9364-469eec53967d on hv-cinder-84213 May 26 20:29:26.866725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-0645c0f7-6f79-4a06-ad1f-47a59ac950a5 req-6e4c8ceb-a6ca-4444-b953-bf5de3eabfc8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030295 May 26 20:29:26.867240 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 334/661] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:26.947132 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-63a4c290-186c-4d4d-aea1-5a70b4da381c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:26.947867 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-63a4c290-186c-4d4d-aea1-5a70b4da381c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:26.950606 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=4 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:26.951874 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=22 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:26.956861 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63a4c290-186c-4d4d-aea1-5a70b4da381c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:26.957443 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63a4c290-186c-4d4d-aea1-5a70b4da381c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:26.958305 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63a4c290-186c-4d4d-aea1-5a70b4da381c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:26.959234 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63a4c290-186c-4d4d-aea1-5a70b4da381c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:27.119869 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c0c62b0c-27b8-4874-a33a-08cf12256d73 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:27.120830 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c0c62b0c-27b8-4874-a33a-08cf12256d73 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:27.127793 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c0c62b0c-27b8-4874-a33a-08cf12256d73 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:27.128505 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c0c62b0c-27b8-4874-a33a-08cf12256d73 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:27.129448 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c0c62b0c-27b8-4874-a33a-08cf12256d73 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:27.130046 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c0c62b0c-27b8-4874-a33a-08cf12256d73 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:27.175034 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-63a4c290-186c-4d4d-aea1-5a70b4da381c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:27.183362 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-63a4c290-186c-4d4d-aea1-5a70b4da381c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:27.185139 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-63a4c290-186c-4d4d-aea1-5a70b4da381c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:27.186490 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-63a4c290-186c-4d4d-aea1-5a70b4da381c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1598 microversion: 2.20 time: 0.243621 May 26 20:29:27.197168 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 328/662] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:29:26 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1598 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:29:27.204378 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-32bd8ce6-3c0b-49dc-8054-0ef6d29d8f1e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:27.205026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-32bd8ce6-3c0b-49dc-8054-0ef6d29d8f1e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:27.211528 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-32bd8ce6-3c0b-49dc-8054-0ef6d29d8f1e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:27.212110 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-32bd8ce6-3c0b-49dc-8054-0ef6d29d8f1e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:27.212992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-32bd8ce6-3c0b-49dc-8054-0ef6d29d8f1e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:27.213694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-32bd8ce6-3c0b-49dc-8054-0ef6d29d8f1e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:27.296823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c0c62b0c-27b8-4874-a33a-08cf12256d73 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:27.305785 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c0c62b0c-27b8-4874-a33a-08cf12256d73 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.190006 May 26 20:29:27.306911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 335/663] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:27 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:27.330038 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-32bd8ce6-3c0b-49dc-8054-0ef6d29d8f1e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.129499 May 26 20:29:27.330923 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 329/664] 10.222.0.44 () {60 vars in 1315 bytes} [Thu May 26 20:29:27 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 20:29:27.381389 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e2c346f4-d41d-40b2-ae8b-d85da4e0251e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:27.383219 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e2c346f4-d41d-40b2-ae8b-d85da4e0251e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:27.389311 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-daa08722-b20b-43b1-a6cd-8deae4fbd9c5 req-4dc79ae6-8270-4ba4-b3c7-c8b1aa0cfa00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6565432e-8214-4e00-84ca-525f7acc6c8c", "name": "network-vif-plugged", "status": "completed", "tag": "e69ae7b9-16d9-473a-85f4-968fc5e64a24"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:27.392244 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e2c346f4-d41d-40b2-ae8b-d85da4e0251e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:27.392952 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e2c346f4-d41d-40b2-ae8b-d85da4e0251e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:27.394022 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e2c346f4-d41d-40b2-ae8b-d85da4e0251e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:27.394706 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e2c346f4-d41d-40b2-ae8b-d85da4e0251e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:27.405808 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-daa08722-b20b-43b1-a6cd-8deae4fbd9c5 req-4dc79ae6-8270-4ba4-b3c7-c8b1aa0cfa00 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:27.406259 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-daa08722-b20b-43b1-a6cd-8deae4fbd9c5 req-4dc79ae6-8270-4ba4-b3c7-c8b1aa0cfa00 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:27.434018 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-daa08722-b20b-43b1-a6cd-8deae4fbd9c5 req-4dc79ae6-8270-4ba4-b3c7-c8b1aa0cfa00 service nova] Creating event network-vif-plugged:e69ae7b9-16d9-473a-85f4-968fc5e64a24 for instance 6565432e-8214-4e00-84ca-525f7acc6c8c on hv-cinder-84213 May 26 20:29:27.443988 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-daa08722-b20b-43b1-a6cd-8deae4fbd9c5 req-4dc79ae6-8270-4ba4-b3c7-c8b1aa0cfa00 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058557 May 26 20:29:27.445143 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 330/665] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:29:27.690612 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e2c346f4-d41d-40b2-ae8b-d85da4e0251e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:27.700352 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e2c346f4-d41d-40b2-ae8b-d85da4e0251e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1367 microversion: 2.1 time: 0.322767 May 26 20:29:27.701145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 336/666] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:27 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:28.328687 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-bd37db20-4532-431d-b4ee-25dc648e59dd tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:28.329392 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-bd37db20-4532-431d-b4ee-25dc648e59dd tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:28.335750 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bd37db20-4532-431d-b4ee-25dc648e59dd tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:28.336203 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bd37db20-4532-431d-b4ee-25dc648e59dd tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:28.337021 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bd37db20-4532-431d-b4ee-25dc648e59dd tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:28.337462 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bd37db20-4532-431d-b4ee-25dc648e59dd tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:28.485486 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-bd37db20-4532-431d-b4ee-25dc648e59dd tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:28.493680 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-bd37db20-4532-431d-b4ee-25dc648e59dd tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.170158 May 26 20:29:28.494274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 331/667] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:28 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:28.717816 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-26c88917-6d11-4cce-8c2d-99556bf186da tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:28.718471 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-26c88917-6d11-4cce-8c2d-99556bf186da tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:28.724955 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-26c88917-6d11-4cce-8c2d-99556bf186da tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:28.725402 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-26c88917-6d11-4cce-8c2d-99556bf186da tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:28.726172 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-26c88917-6d11-4cce-8c2d-99556bf186da tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:28.726629 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-26c88917-6d11-4cce-8c2d-99556bf186da tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:28.861946 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-26c88917-6d11-4cce-8c2d-99556bf186da tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:28.869298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-26c88917-6d11-4cce-8c2d-99556bf186da tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1367 microversion: 2.1 time: 0.156277 May 26 20:29:28.870076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 337/668] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:28 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:28.881026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-b48674e5-6d0a-4507-9a2c-0790b7333c88 req-9e7fb185-d18c-4d6f-84a3-043263073e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "419dd0d9-334f-4481-aa27-8c24115614db", "tag": "9ff1ecd8-c0e6-4014-b5c2-850b82d549df"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:28.889685 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-b48674e5-6d0a-4507-9a2c-0790b7333c88 req-9e7fb185-d18c-4d6f-84a3-043263073e4d service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:28.890284 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-b48674e5-6d0a-4507-9a2c-0790b7333c88 req-9e7fb185-d18c-4d6f-84a3-043263073e4d service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:28.901312 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-b48674e5-6d0a-4507-9a2c-0790b7333c88 req-9e7fb185-d18c-4d6f-84a3-043263073e4d service nova] Creating event network-changed:9ff1ecd8-c0e6-4014-b5c2-850b82d549df for instance 419dd0d9-334f-4481-aa27-8c24115614db on hv-cinder-84213 May 26 20:29:28.906803 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-b48674e5-6d0a-4507-9a2c-0790b7333c88 req-9e7fb185-d18c-4d6f-84a3-043263073e4d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029510 May 26 20:29:28.907889 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 332/669] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:29.512834 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0efc1c26-c79f-443e-8b2a-2a0b71c8e4ae tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:29.513785 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0efc1c26-c79f-443e-8b2a-2a0b71c8e4ae tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:29.520582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0efc1c26-c79f-443e-8b2a-2a0b71c8e4ae tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:29.521038 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0efc1c26-c79f-443e-8b2a-2a0b71c8e4ae tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:29.521820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0efc1c26-c79f-443e-8b2a-2a0b71c8e4ae tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:29.522276 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0efc1c26-c79f-443e-8b2a-2a0b71c8e4ae tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:29.676477 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-0efc1c26-c79f-443e-8b2a-2a0b71c8e4ae tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:29.689262 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0efc1c26-c79f-443e-8b2a-2a0b71c8e4ae tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.181269 May 26 20:29:29.689945 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 338/670] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:29 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:29.887835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7d17ed13-a23b-4c8e-acd2-352a5a10ab05 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:29.888547 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7d17ed13-a23b-4c8e-acd2-352a5a10ab05 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:29.894796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d17ed13-a23b-4c8e-acd2-352a5a10ab05 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:29.895239 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d17ed13-a23b-4c8e-acd2-352a5a10ab05 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:29.896034 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d17ed13-a23b-4c8e-acd2-352a5a10ab05 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:29.896601 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7d17ed13-a23b-4c8e-acd2-352a5a10ab05 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:30.097395 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7d17ed13-a23b-4c8e-acd2-352a5a10ab05 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:30.104876 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7d17ed13-a23b-4c8e-acd2-352a5a10ab05 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1555 microversion: 2.1 time: 0.222129 May 26 20:29:30.105445 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 333/671] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:29 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1555 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:30.122004 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-bbcdaaec-71c1-4c32-b4f9-c0cc0da7e479 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:30.122592 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-bbcdaaec-71c1-4c32-b4f9-c0cc0da7e479 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:30.128953 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bbcdaaec-71c1-4c32-b4f9-c0cc0da7e479 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:30.131754 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bbcdaaec-71c1-4c32-b4f9-c0cc0da7e479 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:30.131754 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bbcdaaec-71c1-4c32-b4f9-c0cc0da7e479 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:30.131754 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bbcdaaec-71c1-4c32-b4f9-c0cc0da7e479 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:30.209247 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-bbcdaaec-71c1-4c32-b4f9-c0cc0da7e479 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091208 May 26 20:29:30.209877 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 339/672] 10.222.0.44 () {58 vars in 1274 bytes} [Thu May 26 20:29:30 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:30.706953 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3b10fbe3-a86a-4e5b-9e31-a4d202af7d14 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:30.707585 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3b10fbe3-a86a-4e5b-9e31-a4d202af7d14 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:30.713605 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b10fbe3-a86a-4e5b-9e31-a4d202af7d14 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:30.714202 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b10fbe3-a86a-4e5b-9e31-a4d202af7d14 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:30.714902 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b10fbe3-a86a-4e5b-9e31-a4d202af7d14 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:30.716752 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3b10fbe3-a86a-4e5b-9e31-a4d202af7d14 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:30.863455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-3b10fbe3-a86a-4e5b-9e31-a4d202af7d14 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:30.872036 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3b10fbe3-a86a-4e5b-9e31-a4d202af7d14 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.168339 May 26 20:29:30.872604 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 334/673] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:30 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:31.222633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-ee5bbe3b-865d-45bb-99b6-d2dca05b605a req-3ef02fe4-aacd-4403-a90f-ef6a253e99ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6565432e-8214-4e00-84ca-525f7acc6c8c", "tag": "e69ae7b9-16d9-473a-85f4-968fc5e64a24"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:31.231355 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-ee5bbe3b-865d-45bb-99b6-d2dca05b605a req-3ef02fe4-aacd-4403-a90f-ef6a253e99ce service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:31.231786 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-ee5bbe3b-865d-45bb-99b6-d2dca05b605a req-3ef02fe4-aacd-4403-a90f-ef6a253e99ce service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:31.243819 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-ee5bbe3b-865d-45bb-99b6-d2dca05b605a req-3ef02fe4-aacd-4403-a90f-ef6a253e99ce service nova] Creating event network-changed:e69ae7b9-16d9-473a-85f4-968fc5e64a24 for instance 6565432e-8214-4e00-84ca-525f7acc6c8c on hv-cinder-84213 May 26 20:29:31.249506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-ee5bbe3b-865d-45bb-99b6-d2dca05b605a req-3ef02fe4-aacd-4403-a90f-ef6a253e99ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030915 May 26 20:29:31.250270 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 340/674] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:31.896088 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9beccc55-5f91-45eb-9504-76ad4aa8341a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:31.896088 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9beccc55-5f91-45eb-9504-76ad4aa8341a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:31.896724 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9beccc55-5f91-45eb-9504-76ad4aa8341a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:31.897190 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9beccc55-5f91-45eb-9504-76ad4aa8341a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:31.897970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9beccc55-5f91-45eb-9504-76ad4aa8341a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:31.898438 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9beccc55-5f91-45eb-9504-76ad4aa8341a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:32.047899 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9beccc55-5f91-45eb-9504-76ad4aa8341a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:32.056456 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9beccc55-5f91-45eb-9504-76ad4aa8341a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.171245 May 26 20:29:32.057034 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 335/675] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:31 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:32.462993 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6e9c5197-fa9f-44eb-9794-46a0b722cc9b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:32.463644 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6e9c5197-fa9f-44eb-9794-46a0b722cc9b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:32.470699 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6e9c5197-fa9f-44eb-9794-46a0b722cc9b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:32.471146 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6e9c5197-fa9f-44eb-9794-46a0b722cc9b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:32.471896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6e9c5197-fa9f-44eb-9794-46a0b722cc9b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:32.472328 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6e9c5197-fa9f-44eb-9794-46a0b722cc9b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:32.494760 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6e9c5197-fa9f-44eb-9794-46a0b722cc9b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/ips" status: 200 len: 145 microversion: 2.1 time: 0.036514 May 26 20:29:32.495310 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 341/676] 10.222.0.44 () {58 vars in 1247 bytes} [Thu May 26 20:29:32 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:29:33.072964 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7f7813ed-b463-4133-a8a5-da3f5dd8e811 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:33.073580 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7f7813ed-b463-4133-a8a5-da3f5dd8e811 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:33.080179 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f7813ed-b463-4133-a8a5-da3f5dd8e811 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:33.080634 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f7813ed-b463-4133-a8a5-da3f5dd8e811 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:33.081397 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f7813ed-b463-4133-a8a5-da3f5dd8e811 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:33.081835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f7813ed-b463-4133-a8a5-da3f5dd8e811 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:33.230145 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7f7813ed-b463-4133-a8a5-da3f5dd8e811 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:33.239020 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7f7813ed-b463-4133-a8a5-da3f5dd8e811 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.169979 May 26 20:29:33.239633 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 336/677] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:33 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:34.136058 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-813bf378-05bb-4900-b736-7e79ca357baf tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7924dde6-7b53-43a1-ab9f-350b62d2b409"}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:34.137973 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-813bf378-05bb-4900-b736-7e79ca357baf tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:34.144511 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-813bf378-05bb-4900-b736-7e79ca357baf tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:34.144955 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-813bf378-05bb-4900-b736-7e79ca357baf tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:34.145705 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-813bf378-05bb-4900-b736-7e79ca357baf tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:34.146133 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-813bf378-05bb-4900-b736-7e79ca357baf tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:34.257088 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d82e1c97-0b3f-4d36-a134-8ab50392f299 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:34.257707 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d82e1c97-0b3f-4d36-a134-8ab50392f299 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:34.264317 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d82e1c97-0b3f-4d36-a134-8ab50392f299 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:34.264761 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d82e1c97-0b3f-4d36-a134-8ab50392f299 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:34.265523 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d82e1c97-0b3f-4d36-a134-8ab50392f299 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:34.265959 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d82e1c97-0b3f-4d36-a134-8ab50392f299 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:34.284466 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=100 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:34.410490 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-d82e1c97-0b3f-4d36-a134-8ab50392f299 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:34.419638 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d82e1c97-0b3f-4d36-a134-8ab50392f299 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.165704 May 26 20:29:34.419972 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 337/678] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:34 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:29:34.824788 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-813bf378-05bb-4900-b736-7e79ca357baf tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "POST /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.692360 May 26 20:29:34.825511 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 342/679] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:29:34 2022] POST /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments => generated 194 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:35.436181 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6fa3f629-cafa-401a-b83c-4e6560923cd3 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:35.436798 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6fa3f629-cafa-401a-b83c-4e6560923cd3 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:35.443282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6fa3f629-cafa-401a-b83c-4e6560923cd3 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:35.443730 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6fa3f629-cafa-401a-b83c-4e6560923cd3 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:35.444505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6fa3f629-cafa-401a-b83c-4e6560923cd3 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:35.444990 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6fa3f629-cafa-401a-b83c-4e6560923cd3 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:35.591387 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6fa3f629-cafa-401a-b83c-4e6560923cd3 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:35.599253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6fa3f629-cafa-401a-b83c-4e6560923cd3 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.167477 May 26 20:29:35.599811 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 338/680] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:35 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:36.616989 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-17083137-cf67-4d23-9702-dcf747800ff9 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:36.617740 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-17083137-cf67-4d23-9702-dcf747800ff9 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:36.624734 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-17083137-cf67-4d23-9702-dcf747800ff9 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:36.625183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-17083137-cf67-4d23-9702-dcf747800ff9 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:36.625934 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-17083137-cf67-4d23-9702-dcf747800ff9 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:36.626403 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-17083137-cf67-4d23-9702-dcf747800ff9 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:36.771443 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-17083137-cf67-4d23-9702-dcf747800ff9 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:36.780350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-17083137-cf67-4d23-9702-dcf747800ff9 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.168024 May 26 20:29:36.780939 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 343/681] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:36 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:37.797488 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-20277dda-536f-4487-9b67-b13d034d0435 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:37.798096 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-20277dda-536f-4487-9b67-b13d034d0435 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:37.804725 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20277dda-536f-4487-9b67-b13d034d0435 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:37.805169 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20277dda-536f-4487-9b67-b13d034d0435 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:37.805930 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20277dda-536f-4487-9b67-b13d034d0435 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:37.806394 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20277dda-536f-4487-9b67-b13d034d0435 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:37.948352 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-20277dda-536f-4487-9b67-b13d034d0435 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:37.956805 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-20277dda-536f-4487-9b67-b13d034d0435 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.163849 May 26 20:29:37.957365 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 339/682] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:37 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:38.975850 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-16629758-223f-474e-8567-3ff43b06c275 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:38.977126 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-16629758-223f-474e-8567-3ff43b06c275 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:38.984918 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-16629758-223f-474e-8567-3ff43b06c275 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:38.985376 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-16629758-223f-474e-8567-3ff43b06c275 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:38.986173 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-16629758-223f-474e-8567-3ff43b06c275 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:38.986704 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-16629758-223f-474e-8567-3ff43b06c275 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:39.144307 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-16629758-223f-474e-8567-3ff43b06c275 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:39.152338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-16629758-223f-474e-8567-3ff43b06c275 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.181879 May 26 20:29:39.152905 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 344/683] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:38 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:40.170800 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-edc18b36-46fe-4345-b45a-0d8fcb81dcbe tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:40.171343 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-edc18b36-46fe-4345-b45a-0d8fcb81dcbe tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:40.178389 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-edc18b36-46fe-4345-b45a-0d8fcb81dcbe tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:40.178844 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-edc18b36-46fe-4345-b45a-0d8fcb81dcbe tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:40.179833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-edc18b36-46fe-4345-b45a-0d8fcb81dcbe tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:40.180345 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-edc18b36-46fe-4345-b45a-0d8fcb81dcbe tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:40.326211 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-edc18b36-46fe-4345-b45a-0d8fcb81dcbe tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:40.335283 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-edc18b36-46fe-4345-b45a-0d8fcb81dcbe tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1756 microversion: 2.1 time: 0.169157 May 26 20:29:40.335850 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 340/684] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:40 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:41.352563 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4e24b5e3-f1dc-4b66-9b00-7065aae8e21e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:41.353174 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4e24b5e3-f1dc-4b66-9b00-7065aae8e21e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:41.360003 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4e24b5e3-f1dc-4b66-9b00-7065aae8e21e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:41.360449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4e24b5e3-f1dc-4b66-9b00-7065aae8e21e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:41.364428 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4e24b5e3-f1dc-4b66-9b00-7065aae8e21e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:41.364428 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4e24b5e3-f1dc-4b66-9b00-7065aae8e21e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:41.506263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4e24b5e3-f1dc-4b66-9b00-7065aae8e21e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:41.515302 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4e24b5e3-f1dc-4b66-9b00-7065aae8e21e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1759 microversion: 2.1 time: 0.166647 May 26 20:29:41.515868 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 345/685] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:41 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:29:43.372753 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4d9e8933-6d0e-4c17-bee8-bbe7061d1ee1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:43.374362 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4d9e8933-6d0e-4c17-bee8-bbe7061d1ee1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:43.380362 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d9e8933-6d0e-4c17-bee8-bbe7061d1ee1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:43.380820 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d9e8933-6d0e-4c17-bee8-bbe7061d1ee1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:43.381586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d9e8933-6d0e-4c17-bee8-bbe7061d1ee1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:43.382025 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4d9e8933-6d0e-4c17-bee8-bbe7061d1ee1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:43.410009 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4d9e8933-6d0e-4c17-bee8-bbe7061d1ee1 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041301 May 26 20:29:43.410587 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 341/686] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:29:43 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:43.420759 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ded8af9d-91b1-4953-b2e2-f6f9c34832c8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:43.421278 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ded8af9d-91b1-4953-b2e2-f6f9c34832c8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:43.427756 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ded8af9d-91b1-4953-b2e2-f6f9c34832c8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:43.428201 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ded8af9d-91b1-4953-b2e2-f6f9c34832c8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:43.428973 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ded8af9d-91b1-4953-b2e2-f6f9c34832c8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:43.429405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ded8af9d-91b1-4953-b2e2-f6f9c34832c8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:43.458171 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ded8af9d-91b1-4953-b2e2-f6f9c34832c8 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments/7924dde6-7b53-43a1-ab9f-350b62d2b409" status: 200 len: 194 microversion: 2.1 time: 0.041889 May 26 20:29:43.458786 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 346/687] 10.222.0.44 () {58 vars in 1412 bytes} [Thu May 26 20:29:43 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments/7924dde6-7b53-43a1-ab9f-350b62d2b409 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:45.101038 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e0236888-aab0-4b0e-be75-3f51dc437145 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c28fa0e-d45f-41ad-b19b-cf5756ed0f24"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:29:45.102131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e0236888-aab0-4b0e-be75-3f51dc437145 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:45.108647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0236888-aab0-4b0e-be75-3f51dc437145 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:45.109779 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0236888-aab0-4b0e-be75-3f51dc437145 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:45.110568 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0236888-aab0-4b0e-be75-3f51dc437145 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:45.111011 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e0236888-aab0-4b0e-be75-3f51dc437145 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:45.847985 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e0236888-aab0-4b0e-be75-3f51dc437145 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "POST /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750655 May 26 20:29:45.848605 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 342/688] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:29:45 2022] POST /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:54.389875 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1ae32b2d-270d-4d19-9f6d-c86ede62d305 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:54.390904 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-1ae32b2d-270d-4d19-9f6d-c86ede62d305 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:54.393492 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=43 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:54.394373 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:54.399614 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1ae32b2d-270d-4d19-9f6d-c86ede62d305 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:54.410073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1ae32b2d-270d-4d19-9f6d-c86ede62d305 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:54.410073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1ae32b2d-270d-4d19-9f6d-c86ede62d305 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:54.410073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1ae32b2d-270d-4d19-9f6d-c86ede62d305 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:54.430638 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1ae32b2d-270d-4d19-9f6d-c86ede62d305 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044583 May 26 20:29:54.431195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 347/689] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:29:54 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:54.579568 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-75f5d4e4-9b10-4178-918a-31f7d80d7247 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:54.580119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-75f5d4e4-9b10-4178-918a-31f7d80d7247 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:54.582002 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=52 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:29:54.588102 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75f5d4e4-9b10-4178-918a-31f7d80d7247 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:54.593228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75f5d4e4-9b10-4178-918a-31f7d80d7247 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:54.593228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75f5d4e4-9b10-4178-918a-31f7d80d7247 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:54.593228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-75f5d4e4-9b10-4178-918a-31f7d80d7247 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:54.624536 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-75f5d4e4-9b10-4178-918a-31f7d80d7247 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments/7924dde6-7b53-43a1-ab9f-350b62d2b409" status: 200 len: 194 microversion: 2.1 time: 0.049987 May 26 20:29:54.625136 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 343/690] 10.222.0.44 () {58 vars in 1412 bytes} [Thu May 26 20:29:54 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments/7924dde6-7b53-43a1-ab9f-350b62d2b409 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:54.636322 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-bec6fb85-1ec0-4de7-9186-3bdb6fffe64b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:54.636848 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-bec6fb85-1ec0-4de7-9186-3bdb6fffe64b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:54.646166 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bec6fb85-1ec0-4de7-9186-3bdb6fffe64b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:54.646636 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bec6fb85-1ec0-4de7-9186-3bdb6fffe64b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:54.647392 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bec6fb85-1ec0-4de7-9186-3bdb6fffe64b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:54.647820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bec6fb85-1ec0-4de7-9186-3bdb6fffe64b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:54.733541 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-bec6fb85-1ec0-4de7-9186-3bdb6fffe64b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lazy-loading 'services' on Instance uuid ea0bd3fb-4338-41a5-84ab-d70795eeb59e {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:29:54.928555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-bec6fb85-1ec0-4de7-9186-3bdb6fffe64b tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments/7924dde6-7b53-43a1-ab9f-350b62d2b409" status: 202 len: 0 microversion: 2.1 time: 0.296666 May 26 20:29:54.929301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 348/691] 10.222.0.44 () {58 vars in 1415 bytes} [Thu May 26 20:29:54 2022] DELETE /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments/7924dde6-7b53-43a1-ab9f-350b62d2b409 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:29:57.114692 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-965910c1-2622-40ea-a56c-b0d0ccf27b1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:57.115188 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-965910c1-2622-40ea-a56c-b0d0ccf27b1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:57.122388 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-965910c1-2622-40ea-a56c-b0d0ccf27b1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:57.122881 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-965910c1-2622-40ea-a56c-b0d0ccf27b1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:57.123650 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-965910c1-2622-40ea-a56c-b0d0ccf27b1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:57.124091 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-965910c1-2622-40ea-a56c-b0d0ccf27b1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:57.152693 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-965910c1-2622-40ea-a56c-b0d0ccf27b1f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments/9c28fa0e-d45f-41ad-b19b-cf5756ed0f24" status: 200 len: 194 microversion: 2.1 time: 0.041926 May 26 20:29:57.153274 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 344/692] 10.222.0.44 () {58 vars in 1412 bytes} [Thu May 26 20:29:57 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments/9c28fa0e-d45f-41ad-b19b-cf5756ed0f24 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:29:57.163916 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a8791ab8-e514-442a-8415-97b07599714f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:57.164487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a8791ab8-e514-442a-8415-97b07599714f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:57.171107 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a8791ab8-e514-442a-8415-97b07599714f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:57.171548 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a8791ab8-e514-442a-8415-97b07599714f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:57.172295 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a8791ab8-e514-442a-8415-97b07599714f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:57.172720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a8791ab8-e514-442a-8415-97b07599714f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:57.253752 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-a8791ab8-e514-442a-8415-97b07599714f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lazy-loading 'services' on Instance uuid ea0bd3fb-4338-41a5-84ab-d70795eeb59e {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:29:57.499396 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a8791ab8-e514-442a-8415-97b07599714f tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments/9c28fa0e-d45f-41ad-b19b-cf5756ed0f24" status: 202 len: 0 microversion: 2.1 time: 0.340069 May 26 20:29:57.500051 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 349/693] 10.222.0.44 () {58 vars in 1415 bytes} [Thu May 26 20:29:57 2022] DELETE /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments/9c28fa0e-d45f-41ad-b19b-cf5756ed0f24 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:29:58.668196 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-85224e0d-da9c-43ff-9def-83a3181826f2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:58.669192 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-85224e0d-da9c-43ff-9def-83a3181826f2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:58.675653 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-85224e0d-da9c-43ff-9def-83a3181826f2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:58.676609 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-85224e0d-da9c-43ff-9def-83a3181826f2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:58.676868 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-85224e0d-da9c-43ff-9def-83a3181826f2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:58.677308 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-85224e0d-da9c-43ff-9def-83a3181826f2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:58.705429 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-85224e0d-da9c-43ff-9def-83a3181826f2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041183 May 26 20:29:58.705981 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 345/694] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:29:58 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 20:29:58.812547 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b1fafa6c-12b3-4358-8236-a906c958401c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:58.813549 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b1fafa6c-12b3-4358-8236-a906c958401c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:58.820276 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b1fafa6c-12b3-4358-8236-a906c958401c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:58.820719 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b1fafa6c-12b3-4358-8236-a906c958401c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:58.821469 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b1fafa6c-12b3-4358-8236-a906c958401c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:58.821898 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b1fafa6c-12b3-4358-8236-a906c958401c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:58.850172 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b1fafa6c-12b3-4358-8236-a906c958401c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042088 May 26 20:29:58.851446 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 350/695] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:29:58 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 20:29:58.908914 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e9ad664b-7c6c-4ef5-b08e-ae08bcd6991e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:58.909469 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e9ad664b-7c6c-4ef5-b08e-ae08bcd6991e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:58.919101 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9ad664b-7c6c-4ef5-b08e-ae08bcd6991e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:58.919560 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9ad664b-7c6c-4ef5-b08e-ae08bcd6991e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:58.920348 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9ad664b-7c6c-4ef5-b08e-ae08bcd6991e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:58.920791 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e9ad664b-7c6c-4ef5-b08e-ae08bcd6991e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:58.945366 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e9ad664b-7c6c-4ef5-b08e-ae08bcd6991e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:29:59.305888 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e9ad664b-7c6c-4ef5-b08e-ae08bcd6991e tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 204 len: 0 microversion: 2.1 time: 0.400528 May 26 20:29:59.306544 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 346/696] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:29:58 2022] DELETE /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:29:59.314619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-88bb80e2-09ce-448e-b71a-9c18d5c7b692 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:29:59.315226 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-88bb80e2-09ce-448e-b71a-9c18d5c7b692 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:29:59.321930 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-88bb80e2-09ce-448e-b71a-9c18d5c7b692 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:59.322405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-88bb80e2-09ce-448e-b71a-9c18d5c7b692 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:59.323157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-88bb80e2-09ce-448e-b71a-9c18d5c7b692 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:29:59.323585 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-88bb80e2-09ce-448e-b71a-9c18d5c7b692 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:29:59.457938 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-88bb80e2-09ce-448e-b71a-9c18d5c7b692 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:29:59.465784 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-88bb80e2-09ce-448e-b71a-9c18d5c7b692 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1673 microversion: 2.1 time: 0.155062 May 26 20:29:59.466559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 351/697] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:29:59 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:00.483357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4784d564-bc02-49ff-a9aa-6799553faa16 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:00.484098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4784d564-bc02-49ff-a9aa-6799553faa16 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:00.490681 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4784d564-bc02-49ff-a9aa-6799553faa16 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:00.491143 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4784d564-bc02-49ff-a9aa-6799553faa16 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:00.492440 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4784d564-bc02-49ff-a9aa-6799553faa16 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:00.492884 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4784d564-bc02-49ff-a9aa-6799553faa16 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:00.621268 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-4784d564-bc02-49ff-a9aa-6799553faa16 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:00.628714 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4784d564-bc02-49ff-a9aa-6799553faa16 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1673 microversion: 2.1 time: 0.149573 May 26 20:30:00.629321 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 347/698] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:00 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:01.645509 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-159922b6-e511-44f5-83d5-dc3bdd5b254c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:01.645909 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-159922b6-e511-44f5-83d5-dc3bdd5b254c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:01.652525 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-159922b6-e511-44f5-83d5-dc3bdd5b254c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:01.652968 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-159922b6-e511-44f5-83d5-dc3bdd5b254c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:01.653728 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-159922b6-e511-44f5-83d5-dc3bdd5b254c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:01.654154 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-159922b6-e511-44f5-83d5-dc3bdd5b254c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:01.788022 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-159922b6-e511-44f5-83d5-dc3bdd5b254c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:01.796186 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-159922b6-e511-44f5-83d5-dc3bdd5b254c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1673 microversion: 2.1 time: 0.155094 May 26 20:30:01.796757 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 352/699] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:01 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:02.323104 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-29525f11-ec72-4b97-9bb3-ddf7b3c6aec6 req-33c18581-7146-4a4e-ab8b-e7f3d7533c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0bd3fb-4338-41a5-84ab-d70795eeb59e", "name": "network-vif-deleted", "tag": "9bd4765f-7998-4f04-8160-2f7cf452abe1"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:02.332721 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-29525f11-ec72-4b97-9bb3-ddf7b3c6aec6 req-33c18581-7146-4a4e-ab8b-e7f3d7533c48 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:02.333651 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-29525f11-ec72-4b97-9bb3-ddf7b3c6aec6 req-33c18581-7146-4a4e-ab8b-e7f3d7533c48 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:02.345422 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-29525f11-ec72-4b97-9bb3-ddf7b3c6aec6 req-33c18581-7146-4a4e-ab8b-e7f3d7533c48 service nova] Creating event network-vif-deleted:9bd4765f-7998-4f04-8160-2f7cf452abe1 for instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e on hv-cinder-84213 May 26 20:30:02.350206 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-29525f11-ec72-4b97-9bb3-ddf7b3c6aec6 req-33c18581-7146-4a4e-ab8b-e7f3d7533c48 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030873 May 26 20:30:02.352741 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 348/700] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:02.813837 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-d7b0524f-efe3-4570-93a8-b285549ec639 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:02.814479 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-d7b0524f-efe3-4570-93a8-b285549ec639 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:02.821742 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d7b0524f-efe3-4570-93a8-b285549ec639 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:02.822179 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d7b0524f-efe3-4570-93a8-b285549ec639 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:02.822962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d7b0524f-efe3-4570-93a8-b285549ec639 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:02.823386 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d7b0524f-efe3-4570-93a8-b285549ec639 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:02.855830 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d7b0524f-efe3-4570-93a8-b285549ec639 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:02.856272 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d7b0524f-efe3-4570-93a8-b285549ec639 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:02.856715 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-d7b0524f-efe3-4570-93a8-b285549ec639 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lazy-loading 'fault' on Instance uuid ea0bd3fb-4338-41a5-84ab-d70795eeb59e {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:30:02.897845 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-d7b0524f-efe3-4570-93a8-b285549ec639 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35a55bcc5754bf88adbd343ab8116d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414b3aedf5e947d39018df71b2f106ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:02.905470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-d7b0524f-efe3-4570-93a8-b285549ec639 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 200 len: 1327 microversion: 2.1 time: 0.095466 May 26 20:30:02.906292 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 353/701] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:02 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:03.926674 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1482f593-9849-43c2-9f45-2d01d1656daa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:03.927610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1482f593-9849-43c2-9f45-2d01d1656daa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:03.934607 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1482f593-9849-43c2-9f45-2d01d1656daa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:03.935058 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1482f593-9849-43c2-9f45-2d01d1656daa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:03.935853 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1482f593-9849-43c2-9f45-2d01d1656daa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:03.936293 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1482f593-9849-43c2-9f45-2d01d1656daa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:03.950103 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-1482f593-9849-43c2-9f45-2d01d1656daa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] HTTP exception thrown: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1482f593-9849-43c2-9f45-2d01d1656daa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Request method failure captured: May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e HTTP/1.1 May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HHgWoY06vmFkOlQs2T9nnABRYdwtUiwO68G1UB-MdamE4DxSLlm9O0B7P2XdiKZfaOvA51ORcm2WFaKgu7kkt4xTzFlRZCJ9MrEtQEeXqRdEk2hfzGfKgVnVoefk5nvAsfpCu_6Bsly54_Zi9ednQJhAGMWUYS19tEbCOwSLpaDhQ May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 414b3aedf5e947d39018df71b2f106ba May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:30:03.951755 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:30:03.953367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:03.953367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:03.953367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 414b3aedf5e947d39018df71b2f106ba May 26 20:30:03.953367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:03.953367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeTestJSON-501724308-project May 26 20:30:03.953367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:30:03.953367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:30:03.953367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: d35a55bcc5754bf88adbd343ab8116d2 May 26 20:30:03.953367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeTestJSON-501724308-project May 26 20:30:03.953367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:30:03.953367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:03.953367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': 'ea0bd3fb-4338-41a5-84ab-d70795eeb59e'} May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:03.954314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:03.955921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:03.957422 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1482f593-9849-43c2-9f45-2d01d1656daa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Returning 404 to user: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:03.957422 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1482f593-9849-43c2-9f45-2d01d1656daa tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 404 len: 111 microversion: 2.1 time: 0.033183 May 26 20:30:03.957422 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 349/702] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:03 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 20:30:03.962112 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4336227e-c1b4-4cb6-b2ec-2d524532b601 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '.version_select at 0x7f2da443f4c0>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:04.038065 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4336227e-c1b4-4cb6-b2ec-2d524532b601 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698798515" status: 202 len: 0 microversion: 2.1 time: 0.079666 May 26 20:30:04.038678 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 354/703] 10.222.0.44 () {58 vars in 1220 bytes} [Thu May 26 20:30:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698798515 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:30:07.333563 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-85c69736-4e23-4523-b6fc-82dfc793a8c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:07.334204 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-85c69736-4e23-4523-b6fc-82dfc793a8c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:07.341596 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-85c69736-4e23-4523-b6fc-82dfc793a8c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:07.342046 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-85c69736-4e23-4523-b6fc-82dfc793a8c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:07.342853 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-85c69736-4e23-4523-b6fc-82dfc793a8c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:07.343295 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-85c69736-4e23-4523-b6fc-82dfc793a8c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:07.347408 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-85c69736-4e23-4523-b6fc-82dfc793a8c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] HTTP exception thrown: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-85c69736-4e23-4523-b6fc-82dfc793a8c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Request method failure captured: May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: DELETE /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e HTTP/1.1 May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HHgWoY06vmFkOlQs2T9nnABRYdwtUiwO68G1UB-MdamE4DxSLlm9O0B7P2XdiKZfaOvA51ORcm2WFaKgu7kkt4xTzFlRZCJ9MrEtQEeXqRdEk2hfzGfKgVnVoefk5nvAsfpCu_6Bsly54_Zi9ednQJhAGMWUYS19tEbCOwSLpaDhQ May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 414b3aedf5e947d39018df71b2f106ba May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:30:07.362649 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:30:07.364329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:07.364329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:07.364329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 414b3aedf5e947d39018df71b2f106ba May 26 20:30:07.364329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:07.364329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeTestJSON-501724308-project May 26 20:30:07.364329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:30:07.364329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:30:07.364329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: d35a55bcc5754bf88adbd343ab8116d2 May 26 20:30:07.364329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeTestJSON-501724308-project May 26 20:30:07.364329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:30:07.364329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:07.364329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': 'ea0bd3fb-4338-41a5-84ab-d70795eeb59e'} May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:07.365357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:07.366978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:07.368443 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-85c69736-4e23-4523-b6fc-82dfc793a8c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Returning 404 to user: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:07.368443 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-85c69736-4e23-4523-b6fc-82dfc793a8c9 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 404 len: 111 microversion: 2.1 time: 0.031136 May 26 20:30:07.368443 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 350/704] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:30:07 2022] DELETE /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:07.371941 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-da1ee27b-592e-4364-88c2-a6737b1bb693 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:07.372553 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-da1ee27b-592e-4364-88c2-a6737b1bb693 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: ea0bd3fb-4338-41a5-84ab-d70795eeb59e] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:07.378615 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-da1ee27b-592e-4364-88c2-a6737b1bb693 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:07.379064 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-da1ee27b-592e-4364-88c2-a6737b1bb693 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:07.379819 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-da1ee27b-592e-4364-88c2-a6737b1bb693 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:07.380257 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-da1ee27b-592e-4364-88c2-a6737b1bb693 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:07.393896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-da1ee27b-592e-4364-88c2-a6737b1bb693 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] HTTP exception thrown: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-da1ee27b-592e-4364-88c2-a6737b1bb693 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Request method failure captured: May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e HTTP/1.1 May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-HHgWoY06vmFkOlQs2T9nnABRYdwtUiwO68G1UB-MdamE4DxSLlm9O0B7P2XdiKZfaOvA51ORcm2WFaKgu7kkt4xTzFlRZCJ9MrEtQEeXqRdEk2hfzGfKgVnVoefk5nvAsfpCu_6Bsly54_Zi9ednQJhAGMWUYS19tEbCOwSLpaDhQ May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: 414b3aedf5e947d39018df71b2f106ba May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:30:07.395555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:30:07.397061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:07.397061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:07.397061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: 414b3aedf5e947d39018df71b2f106ba May 26 20:30:07.397061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:07.397061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-AttachVolumeTestJSON-501724308-project May 26 20:30:07.397061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:30:07.397061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:30:07.397061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: d35a55bcc5754bf88adbd343ab8116d2 May 26 20:30:07.397061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-AttachVolumeTestJSON-501724308-project May 26 20:30:07.397061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:30:07.397061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:07.397061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': 'ea0bd3fb-4338-41a5-84ab-d70795eeb59e'} May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:07.397902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. May 26 20:30:07.399338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:07.400680 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-da1ee27b-592e-4364-88c2-a6737b1bb693 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Returning 404 to user: Instance ea0bd3fb-4338-41a5-84ab-d70795eeb59e could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:07.400680 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-da1ee27b-592e-4364-88c2-a6737b1bb693 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e" status: 404 len: 111 microversion: 2.1 time: 0.030401 May 26 20:30:07.400680 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 355/705] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:07 2022] GET /compute/v2.1/servers/ea0bd3fb-4338-41a5-84ab-d70795eeb59e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:08.685155 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cca94f87-b0c0-48ac-838b-c6de4854daa2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:08.685637 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cca94f87-b0c0-48ac-838b-c6de4854daa2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:08.692862 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cca94f87-b0c0-48ac-838b-c6de4854daa2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:08.694561 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cca94f87-b0c0-48ac-838b-c6de4854daa2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:08.694561 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cca94f87-b0c0-48ac-838b-c6de4854daa2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:08.694561 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cca94f87-b0c0-48ac-838b-c6de4854daa2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:08.708026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-cca94f87-b0c0-48ac-838b-c6de4854daa2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] HTTP exception thrown: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cca94f87-b0c0-48ac-838b-c6de4854daa2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Request method failure captured: May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: DELETE /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f HTTP/1.1 May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-HHgWoY06vmFkOlQs2T9nnABRYdwtUiwO68G1UB-MdamE4DxSLlm9O0B7P2XdiKZfaOvA51ORcm2WFaKgu7kkt4xTzFlRZCJ9MrEtQEeXqRdEk2hfzGfKgVnVoefk5nvAsfpCu_6Bsly54_Zi9ednQJhAGMWUYS19tEbCOwSLpaDhQ May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 414b3aedf5e947d39018df71b2f106ba May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:30:08.709673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:30:08.711265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:08.711265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:08.711265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 414b3aedf5e947d39018df71b2f106ba May 26 20:30:08.711265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:08.711265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeTestJSON-501724308-project May 26 20:30:08.711265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:30:08.711265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:30:08.711265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: d35a55bcc5754bf88adbd343ab8116d2 May 26 20:30:08.711265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeTestJSON-501724308-project May 26 20:30:08.711265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:30:08.711265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:30:08.711265 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f'} May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:08.712078 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:30:08.713280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:08.715336 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cca94f87-b0c0-48ac-838b-c6de4854daa2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Returning 404 to user: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:08.715336 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cca94f87-b0c0-48ac-838b-c6de4854daa2 tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 404 len: 111 microversion: 2.1 time: 0.030481 May 26 20:30:08.715336 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 351/706] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:30:08 2022] DELETE /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:08.719669 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-77bb9e97-f294-4198-8c90-c87b4fd6442c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:08.720275 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-77bb9e97-f294-4198-8c90-c87b4fd6442c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] [instance: 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:08.726717 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-77bb9e97-f294-4198-8c90-c87b4fd6442c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:08.728977 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-77bb9e97-f294-4198-8c90-c87b4fd6442c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:08.728977 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-77bb9e97-f294-4198-8c90-c87b4fd6442c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:08.728977 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-77bb9e97-f294-4198-8c90-c87b4fd6442c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:08.742352 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-77bb9e97-f294-4198-8c90-c87b4fd6442c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] HTTP exception thrown: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-77bb9e97-f294-4198-8c90-c87b4fd6442c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Request method failure captured: May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f HTTP/1.1 May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-HHgWoY06vmFkOlQs2T9nnABRYdwtUiwO68G1UB-MdamE4DxSLlm9O0B7P2XdiKZfaOvA51ORcm2WFaKgu7kkt4xTzFlRZCJ9MrEtQEeXqRdEk2hfzGfKgVnVoefk5nvAsfpCu_6Bsly54_Zi9ednQJhAGMWUYS19tEbCOwSLpaDhQ May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: 414b3aedf5e947d39018df71b2f106ba May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:30:08.743924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:30:08.746045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/414b3aedf5e947d39018df71b2f106ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:08.746045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:08.746045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: 414b3aedf5e947d39018df71b2f106ba May 26 20:30:08.746045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-AttachVolumeTestJSON-501724308 May 26 20:30:08.746045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-AttachVolumeTestJSON-501724308-project May 26 20:30:08.746045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:30:08.746045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:30:08.746045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: d35a55bcc5754bf88adbd343ab8116d2 May 26 20:30:08.746045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-AttachVolumeTestJSON-501724308-project May 26 20:30:08.746045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:30:08.746045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:30:08.746045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f'} May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:08.747134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. May 26 20:30:08.748513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:08.749943 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-77bb9e97-f294-4198-8c90-c87b4fd6442c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] Returning 404 to user: Instance 2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:08.749943 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-77bb9e97-f294-4198-8c90-c87b4fd6442c tempest-AttachVolumeTestJSON-501724308 tempest-AttachVolumeTestJSON-501724308-project] 10.222.0.44 "GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f" status: 404 len: 111 microversion: 2.1 time: 0.029389 May 26 20:30:08.749943 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 356/707] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:08 2022] GET /compute/v2.1/servers/2e7e179d-b3a5-4fac-9a5d-3eb54aff5b1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:13.236611 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6996bd47-9ef5-4b3c-b0a4-fac6fdde39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:13.237531 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6996bd47-9ef5-4b3c-b0a4-fac6fdde39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:13.246477 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6996bd47-9ef5-4b3c-b0a4-fac6fdde39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:13.247151 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6996bd47-9ef5-4b3c-b0a4-fac6fdde39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:13.247928 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6996bd47-9ef5-4b3c-b0a4-fac6fdde39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:13.248455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6996bd47-9ef5-4b3c-b0a4-fac6fdde39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:13.273329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6996bd47-9ef5-4b3c-b0a4-fac6fdde39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/ips" status: 200 len: 151 microversion: 2.20 time: 0.044260 May 26 20:30:13.273894 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 352/708] 10.222.0.44 () {60 vars in 1288 bytes} [Thu May 26 20:30:13 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:30:14.730210 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0f011499-b098-434a-a97b-37bcfc1272d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:14.730745 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0f011499-b098-434a-a97b-37bcfc1272d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:14.736886 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0f011499-b098-434a-a97b-37bcfc1272d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:14.737338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0f011499-b098-434a-a97b-37bcfc1272d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:14.738108 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0f011499-b098-434a-a97b-37bcfc1272d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:14.738586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0f011499-b098-434a-a97b-37bcfc1272d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:14.762909 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0f011499-b098-434a-a97b-37bcfc1272d7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c/ips" status: 200 len: 148 microversion: 2.1 time: 0.205735 May 26 20:30:14.763506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 357/709] 10.222.0.44 () {58 vars in 1247 bytes} [Thu May 26 20:30:14 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c/ips => generated 148 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:15.431369 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f3f386e7-2268-459c-9831-9603dd33564a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:15.431896 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f3f386e7-2268-459c-9831-9603dd33564a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:15.439636 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3f386e7-2268-459c-9831-9603dd33564a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:15.440088 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3f386e7-2268-459c-9831-9603dd33564a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:15.440874 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3f386e7-2268-459c-9831-9603dd33564a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:15.441339 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3f386e7-2268-459c-9831-9603dd33564a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:15.464939 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-f3f386e7-2268-459c-9831-9603dd33564a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lazy-loading 'flavor' on Instance uuid 419dd0d9-334f-4481-aa27-8c24115614db {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:30:15.968334 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f3f386e7-2268-459c-9831-9603dd33564a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "POST /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/action" status: 202 len: 0 microversion: 2.20 time: 0.540817 May 26 20:30:15.968954 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 353/710] 10.222.0.44 () {62 vars in 1318 bytes} [Thu May 26 20:30:15 2022] POST /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 20:30:15.977356 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-810548d1-8052-419d-ae89-f8f5579a9bb0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:15.977979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-810548d1-8052-419d-ae89-f8f5579a9bb0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:15.985133 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-810548d1-8052-419d-ae89-f8f5579a9bb0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:15.985453 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-810548d1-8052-419d-ae89-f8f5579a9bb0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:15.986314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-810548d1-8052-419d-ae89-f8f5579a9bb0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:15.986682 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-810548d1-8052-419d-ae89-f8f5579a9bb0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:16.039237 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fe64b48d-852e-48a2-8b3e-f8e8119eed81 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] Calling method '.version_select at 0x7f2da43b0940>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:16.094906 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fe64b48d-852e-48a2-8b3e-f8e8119eed81 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/88f3c3d7-9498-4324-8761-cb2d69328b68" status: 200 len: 350 microversion: 2.1 time: 0.059749 May 26 20:30:16.095877 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 354/711] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:30:16 2022] GET /compute/v2.1/os-volumes/88f3c3d7-9498-4324-8761-cb2d69328b68 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:30:16.129367 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-810548d1-8052-419d-ae89-f8f5579a9bb0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:16.139359 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-810548d1-8052-419d-ae89-f8f5579a9bb0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:16.140640 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-810548d1-8052-419d-ae89-f8f5579a9bb0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:16.141786 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-810548d1-8052-419d-ae89-f8f5579a9bb0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.168571 May 26 20:30:16.142389 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 358/712] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:15 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:16.368117 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-aef8724e-3128-4c28-a6c1-a7764810acff tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea354702-6462-4794-9294-d23d60e72c94"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:16.369332 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-aef8724e-3128-4c28-a6c1-a7764810acff tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:16.375794 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aef8724e-3128-4c28-a6c1-a7764810acff tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:16.376239 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aef8724e-3128-4c28-a6c1-a7764810acff tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:16.377004 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aef8724e-3128-4c28-a6c1-a7764810acff tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:16.377574 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aef8724e-3128-4c28-a6c1-a7764810acff tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:17.052407 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-aef8724e-3128-4c28-a6c1-a7764810acff tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "POST /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.687937 May 26 20:30:17.053190 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 355/713] 10.222.0.44 () {60 vars in 1322 bytes} [Thu May 26 20:30:16 2022] POST /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:17.160844 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a462ba07-d25b-4466-b156-aafbde48b9d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:17.161594 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a462ba07-d25b-4466-b156-aafbde48b9d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:17.169298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a462ba07-d25b-4466-b156-aafbde48b9d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:17.169961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a462ba07-d25b-4466-b156-aafbde48b9d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:17.178260 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a462ba07-d25b-4466-b156-aafbde48b9d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:17.178260 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a462ba07-d25b-4466-b156-aafbde48b9d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:17.317903 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a462ba07-d25b-4466-b156-aafbde48b9d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:17.326528 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a462ba07-d25b-4466-b156-aafbde48b9d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:17.328109 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a462ba07-d25b-4466-b156-aafbde48b9d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:17.329454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a462ba07-d25b-4466-b156-aafbde48b9d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.172413 May 26 20:30:17.330513 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 359/714] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:17 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:17.680734 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-22996702-f6a5-4f94-8963-27ea8a078a2f tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] Calling method '.version_select at 0x7f2da4362700>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:17.737212 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-22996702-f6a5-4f94-8963-27ea8a078a2f tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/91099d6e-0a47-47dc-a77e-85328f7df0d1" status: 200 len: 351 microversion: 2.1 time: 0.061087 May 26 20:30:17.737780 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 356/715] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:30:17 2022] GET /compute/v2.1/os-volumes/91099d6e-0a47-47dc-a77e-85328f7df0d1 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:18.347764 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2efdf733-3186-48d7-9a8a-cfd757081190 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:18.348973 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2efdf733-3186-48d7-9a8a-cfd757081190 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:18.356367 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2efdf733-3186-48d7-9a8a-cfd757081190 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:18.357160 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2efdf733-3186-48d7-9a8a-cfd757081190 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:18.357941 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2efdf733-3186-48d7-9a8a-cfd757081190 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:18.358564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2efdf733-3186-48d7-9a8a-cfd757081190 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:18.501474 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2efdf733-3186-48d7-9a8a-cfd757081190 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:18.509638 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2efdf733-3186-48d7-9a8a-cfd757081190 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:18.511170 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2efdf733-3186-48d7-9a8a-cfd757081190 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:18.512834 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2efdf733-3186-48d7-9a8a-cfd757081190 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.168973 May 26 20:30:18.513835 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 360/716] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:18 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:19.287138 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f2e025c9-2a09-4122-9ecc-8fec09659ae2 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] Calling method '.version_select at 0x7f2da43b0670>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:19.337545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f2e025c9-2a09-4122-9ecc-8fec09659ae2 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/26bd2d5f-e4e7-4850-acf0-9e27b7cb171e" status: 200 len: 350 microversion: 2.1 time: 0.054532 May 26 20:30:19.338125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 357/717] 10.222.0.44 () {58 vars in 1244 bytes} [Thu May 26 20:30:19 2022] GET /compute/v2.1/os-volumes/26bd2d5f-e4e7-4850-acf0-9e27b7cb171e => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:19.350346 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-f49fd59e-725f-440c-8631-baf1d9dec8e0 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] Calling method '.version_select at 0x7f2da44199d0>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:19.436022 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-f49fd59e-725f-440c-8631-baf1d9dec8e0 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089297 May 26 20:30:19.436787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 361/718] 10.222.0.44 () {58 vars in 1133 bytes} [Thu May 26 20:30:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:19.453601 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c1abaccf-6dca-4aa2-981e-d681df4cc4b6 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] Calling method '.version_select at 0x7f2da4373430>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:19.531554 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-581c742d-971c-478d-b56e-56f85dc28689 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:19.532151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-581c742d-971c-478d-b56e-56f85dc28689 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:19.538820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-581c742d-971c-478d-b56e-56f85dc28689 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:19.539268 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-581c742d-971c-478d-b56e-56f85dc28689 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:19.541733 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-581c742d-971c-478d-b56e-56f85dc28689 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:19.542176 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-581c742d-971c-478d-b56e-56f85dc28689 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:19.542895 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c1abaccf-6dca-4aa2-981e-d681df4cc4b6 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093833 May 26 20:30:19.546278 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 358/719] 10.222.0.44 () {58 vars in 1148 bytes} [Thu May 26 20:30:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:19.555564 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e99214b1-2dea-4459-a686-e0d3dcee8a73 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] Calling method '.version_select at 0x7f2da4373820>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:19.636693 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e99214b1-2dea-4459-a686-e0d3dcee8a73 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084713 May 26 20:30:19.637882 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 359/720] 10.222.0.44 () {58 vars in 1133 bytes} [Thu May 26 20:30:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:30:19.648619 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a2f2c1d9-c4e0-49af-8dfb-0790f607267b tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] Calling method '.version_select at 0x7f2da43b01f0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:19.677479 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-581c742d-971c-478d-b56e-56f85dc28689 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:19.686041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-581c742d-971c-478d-b56e-56f85dc28689 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:19.687510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-581c742d-971c-478d-b56e-56f85dc28689 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:19.688671 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-581c742d-971c-478d-b56e-56f85dc28689 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.161199 May 26 20:30:19.689234 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 362/721] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:19 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:30:19.730144 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a2f2c1d9-c4e0-49af-8dfb-0790f607267b tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085085 May 26 20:30:19.731388 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 360/722] 10.222.0.44 () {58 vars in 1166 bytes} [Thu May 26 20:30:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:19.742802 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0272ba75-47cb-4e29-a9a3-e60103172728 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] Calling method '.version_select at 0x7f2da4482160>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:19.827792 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0272ba75-47cb-4e29-a9a3-e60103172728 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088692 May 26 20:30:19.828362 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 363/723] 10.222.0.44 () {58 vars in 1169 bytes} [Thu May 26 20:30:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:19.841407 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-42fddee2-6a90-40d4-bb07-71b835bf7a40 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] Calling method '.version_select at 0x7f2da4362700>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:19.925047 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-42fddee2-6a90-40d4-bb07-71b835bf7a40 tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088398 May 26 20:30:19.925615 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 361/724] 10.222.0.44 () {58 vars in 1154 bytes} [Thu May 26 20:30:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:19.937002 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b7c72861-e471-4883-a0a5-b1fb5b0ae94e tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] Calling method '.version_select at 0x7f2da4419310>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:20.017512 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b7c72861-e471-4883-a0a5-b1fb5b0ae94e tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084550 May 26 20:30:20.018112 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 364/725] 10.222.0.44 () {58 vars in 1187 bytes} [Thu May 26 20:30:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:20.030269 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0a80efcc-a91e-4131-b9c0-ef6336f18c3c tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] Calling method '.version_select at 0x7f2da433eb80>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:20.109913 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0a80efcc-a91e-4131-b9c0-ef6336f18c3c tempest-VolumesTestJSON-1107552869 tempest-VolumesTestJSON-1107552869-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084118 May 26 20:30:20.110539 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 362/726] 10.222.0.44 () {58 vars in 1154 bytes} [Thu May 26 20:30:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:20.707379 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1074eba6-1c6b-4bc0-a2ce-9a4a119910c0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:20.707981 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-1074eba6-1c6b-4bc0-a2ce-9a4a119910c0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:20.715461 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1074eba6-1c6b-4bc0-a2ce-9a4a119910c0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:20.718980 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1074eba6-1c6b-4bc0-a2ce-9a4a119910c0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:20.718980 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1074eba6-1c6b-4bc0-a2ce-9a4a119910c0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:20.718980 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1074eba6-1c6b-4bc0-a2ce-9a4a119910c0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:20.851596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1074eba6-1c6b-4bc0-a2ce-9a4a119910c0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:20.860800 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1074eba6-1c6b-4bc0-a2ce-9a4a119910c0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:20.866463 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1074eba6-1c6b-4bc0-a2ce-9a4a119910c0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:20.866463 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1074eba6-1c6b-4bc0-a2ce-9a4a119910c0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.160513 May 26 20:30:20.866463 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 365/727] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:20 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:21.882905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-534091b6-d4e1-4540-8b42-518fd6bd9038 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:21.883625 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-534091b6-d4e1-4540-8b42-518fd6bd9038 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:21.890204 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-534091b6-d4e1-4540-8b42-518fd6bd9038 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:21.890685 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-534091b6-d4e1-4540-8b42-518fd6bd9038 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:21.891444 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-534091b6-d4e1-4540-8b42-518fd6bd9038 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:21.891873 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-534091b6-d4e1-4540-8b42-518fd6bd9038 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:22.023167 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-534091b6-d4e1-4540-8b42-518fd6bd9038 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:22.031505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-534091b6-d4e1-4540-8b42-518fd6bd9038 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:22.033014 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-534091b6-d4e1-4540-8b42-518fd6bd9038 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:22.034160 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-534091b6-d4e1-4540-8b42-518fd6bd9038 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.155742 May 26 20:30:22.034737 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 363/728] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:21 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:23.052834 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cc9d784a-02f9-4587-bf34-480c2dc16d64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:23.053444 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-cc9d784a-02f9-4587-bf34-480c2dc16d64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:23.060589 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cc9d784a-02f9-4587-bf34-480c2dc16d64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:23.061032 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cc9d784a-02f9-4587-bf34-480c2dc16d64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:23.061794 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cc9d784a-02f9-4587-bf34-480c2dc16d64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:23.062226 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cc9d784a-02f9-4587-bf34-480c2dc16d64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:23.196815 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cc9d784a-02f9-4587-bf34-480c2dc16d64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:23.204922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cc9d784a-02f9-4587-bf34-480c2dc16d64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:23.206518 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cc9d784a-02f9-4587-bf34-480c2dc16d64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:23.207663 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-cc9d784a-02f9-4587-bf34-480c2dc16d64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.158787 May 26 20:30:23.208230 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 366/729] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:23 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:24.228900 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-06551d4f-e3a9-4f29-ae9b-69eed27995a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:24.229586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-06551d4f-e3a9-4f29-ae9b-69eed27995a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:24.237463 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-06551d4f-e3a9-4f29-ae9b-69eed27995a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:24.245529 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-06551d4f-e3a9-4f29-ae9b-69eed27995a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:24.245529 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-06551d4f-e3a9-4f29-ae9b-69eed27995a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:24.245529 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-06551d4f-e3a9-4f29-ae9b-69eed27995a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:24.373819 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-06551d4f-e3a9-4f29-ae9b-69eed27995a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:24.382671 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-06551d4f-e3a9-4f29-ae9b-69eed27995a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:24.384280 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-06551d4f-e3a9-4f29-ae9b-69eed27995a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:24.385443 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-06551d4f-e3a9-4f29-ae9b-69eed27995a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.162995 May 26 20:30:24.386008 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 364/730] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:24 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:30:24.651566 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-3b0c9bf7-df6a-4c20-9168-c135becc29c0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:24.652054 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3b0c9bf7-df6a-4c20-9168-c135becc29c0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:24.655489 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:30:24.660941 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3b0c9bf7-df6a-4c20-9168-c135becc29c0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:24.661390 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3b0c9bf7-df6a-4c20-9168-c135becc29c0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:24.662185 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3b0c9bf7-df6a-4c20-9168-c135becc29c0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:24.662646 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3b0c9bf7-df6a-4c20-9168-c135becc29c0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:24.681208 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:30:24.751449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-3b0c9bf7-df6a-4c20-9168-c135becc29c0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lazy-loading 'services' on Instance uuid 6565432e-8214-4e00-84ca-525f7acc6c8c {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:30:24.948590 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-3b0c9bf7-df6a-4c20-9168-c135becc29c0 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c/os-volume_attachments/ea354702-6462-4794-9294-d23d60e72c94" status: 202 len: 0 microversion: 2.1 time: 0.300492 May 26 20:30:24.949195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 367/731] 10.222.0.44 () {58 vars in 1415 bytes} [Thu May 26 20:30:24 2022] DELETE /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c/os-volume_attachments/ea354702-6462-4794-9294-d23d60e72c94 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 20:30:24.962580 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c33ac3f9-2e4d-4e63-9325-80e88032b2e2 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:24.962580 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c33ac3f9-2e4d-4e63-9325-80e88032b2e2 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:24.972341 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:30:24.975234 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c33ac3f9-2e4d-4e63-9325-80e88032b2e2 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:24.975678 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c33ac3f9-2e4d-4e63-9325-80e88032b2e2 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:24.976590 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c33ac3f9-2e4d-4e63-9325-80e88032b2e2 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:24.977110 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c33ac3f9-2e4d-4e63-9325-80e88032b2e2 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:25.011414 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c33ac3f9-2e4d-4e63-9325-80e88032b2e2 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057327 May 26 20:30:25.012017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 365/732] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:30:24 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:25.406232 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e420bb2d-56e9-4b83-839e-7b500e6c2fc5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:25.406950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e420bb2d-56e9-4b83-839e-7b500e6c2fc5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:25.413822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e420bb2d-56e9-4b83-839e-7b500e6c2fc5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:25.414301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e420bb2d-56e9-4b83-839e-7b500e6c2fc5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:25.415072 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e420bb2d-56e9-4b83-839e-7b500e6c2fc5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:25.415518 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e420bb2d-56e9-4b83-839e-7b500e6c2fc5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:25.563794 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e420bb2d-56e9-4b83-839e-7b500e6c2fc5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:25.572386 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e420bb2d-56e9-4b83-839e-7b500e6c2fc5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:25.573880 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e420bb2d-56e9-4b83-839e-7b500e6c2fc5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:25.575244 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e420bb2d-56e9-4b83-839e-7b500e6c2fc5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.174283 May 26 20:30:25.586988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 368/733] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:25 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:26.027320 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4f2efead-1921-46b3-a26b-e44a525c2939 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:26.027320 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4f2efead-1921-46b3-a26b-e44a525c2939 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:26.031847 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f2efead-1921-46b3-a26b-e44a525c2939 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:26.032324 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f2efead-1921-46b3-a26b-e44a525c2939 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:26.033293 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f2efead-1921-46b3-a26b-e44a525c2939 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:26.033733 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4f2efead-1921-46b3-a26b-e44a525c2939 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:26.067567 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4f2efead-1921-46b3-a26b-e44a525c2939 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047855 May 26 20:30:26.068285 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 366/734] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:30:26 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 20:30:26.128422 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-727122b3-d96f-42fd-92e4-244e6f99025e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:26.128912 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-727122b3-d96f-42fd-92e4-244e6f99025e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:26.135378 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-727122b3-d96f-42fd-92e4-244e6f99025e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:26.135817 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-727122b3-d96f-42fd-92e4-244e6f99025e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:26.136565 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-727122b3-d96f-42fd-92e4-244e6f99025e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:26.137086 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-727122b3-d96f-42fd-92e4-244e6f99025e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:26.322085 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-727122b3-d96f-42fd-92e4-244e6f99025e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Going to try to terminate instance {{(pid=118306) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:30:26.585395 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-727122b3-d96f-42fd-92e4-244e6f99025e tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 204 len: 0 microversion: 2.1 time: 0.460839 May 26 20:30:26.585909 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 369/735] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:30:26 2022] DELETE /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:30:26.595492 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4b7aea5b-764a-48fc-84da-b57f618af6cd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:26.596358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4b7aea5b-764a-48fc-84da-b57f618af6cd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:26.601589 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-88a8419e-bf1d-4be5-a8f7-7561a4dd11b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:26.602897 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-88a8419e-bf1d-4be5-a8f7-7561a4dd11b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:26.603077 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b7aea5b-764a-48fc-84da-b57f618af6cd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:26.603558 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b7aea5b-764a-48fc-84da-b57f618af6cd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:26.604303 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b7aea5b-764a-48fc-84da-b57f618af6cd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:26.604922 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4b7aea5b-764a-48fc-84da-b57f618af6cd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:26.611395 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-88a8419e-bf1d-4be5-a8f7-7561a4dd11b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:26.611976 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-88a8419e-bf1d-4be5-a8f7-7561a4dd11b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:26.612705 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-88a8419e-bf1d-4be5-a8f7-7561a4dd11b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:26.613137 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-88a8419e-bf1d-4be5-a8f7-7561a4dd11b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:26.750953 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-4b7aea5b-764a-48fc-84da-b57f618af6cd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:26.759579 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4b7aea5b-764a-48fc-84da-b57f618af6cd tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1680 microversion: 2.1 time: 0.169155 May 26 20:30:26.760155 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 367/736] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:26 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:26.769941 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-88a8419e-bf1d-4be5-a8f7-7561a4dd11b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:26.778087 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-88a8419e-bf1d-4be5-a8f7-7561a4dd11b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:26.779611 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-88a8419e-bf1d-4be5-a8f7-7561a4dd11b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:26.781689 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-88a8419e-bf1d-4be5-a8f7-7561a4dd11b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.185024 May 26 20:30:26.782489 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 370/737] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:26 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:27.776747 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f0abfc6e-49f4-4ff7-9a8a-4fc6a6c0a3d6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:27.777356 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f0abfc6e-49f4-4ff7-9a8a-4fc6a6c0a3d6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:27.784480 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0abfc6e-49f4-4ff7-9a8a-4fc6a6c0a3d6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:27.785056 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0abfc6e-49f4-4ff7-9a8a-4fc6a6c0a3d6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:27.785822 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0abfc6e-49f4-4ff7-9a8a-4fc6a6c0a3d6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:27.786473 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0abfc6e-49f4-4ff7-9a8a-4fc6a6c0a3d6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:27.800833 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8f6b7cb4-892e-4199-ba58-52179ca69195 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:27.801443 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8f6b7cb4-892e-4199-ba58-52179ca69195 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:27.807976 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8f6b7cb4-892e-4199-ba58-52179ca69195 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:27.808422 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8f6b7cb4-892e-4199-ba58-52179ca69195 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:27.809178 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8f6b7cb4-892e-4199-ba58-52179ca69195 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:27.809607 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8f6b7cb4-892e-4199-ba58-52179ca69195 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:27.938978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f0abfc6e-49f4-4ff7-9a8a-4fc6a6c0a3d6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:27.946869 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f0abfc6e-49f4-4ff7-9a8a-4fc6a6c0a3d6 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1680 microversion: 2.1 time: 0.173970 May 26 20:30:27.949416 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 368/738] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:27 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:30:27.958615 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8f6b7cb4-892e-4199-ba58-52179ca69195 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:27.966957 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8f6b7cb4-892e-4199-ba58-52179ca69195 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:27.968544 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8f6b7cb4-892e-4199-ba58-52179ca69195 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:27.969699 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8f6b7cb4-892e-4199-ba58-52179ca69195 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.173387 May 26 20:30:27.970320 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 371/739] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:27 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:30:28.964305 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b69bb378-217a-469a-bfd2-77afb8a3089b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:28.965176 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b69bb378-217a-469a-bfd2-77afb8a3089b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:28.973426 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b69bb378-217a-469a-bfd2-77afb8a3089b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:28.974269 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b69bb378-217a-469a-bfd2-77afb8a3089b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:28.975388 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b69bb378-217a-469a-bfd2-77afb8a3089b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:28.976238 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b69bb378-217a-469a-bfd2-77afb8a3089b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:28.994979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5bdff935-062c-427e-9df8-f478b7a2b1d4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:28.994979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5bdff935-062c-427e-9df8-f478b7a2b1d4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:28.999076 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5bdff935-062c-427e-9df8-f478b7a2b1d4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:29.000079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5bdff935-062c-427e-9df8-f478b7a2b1d4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:29.001654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5bdff935-062c-427e-9df8-f478b7a2b1d4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:29.002094 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5bdff935-062c-427e-9df8-f478b7a2b1d4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:29.057996 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b69bb378-217a-469a-bfd2-77afb8a3089b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57c87dc60754d3aa87a84605c7a6889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09dea310ad24870bc5f20241f7f1ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:29.076112 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b69bb378-217a-469a-bfd2-77afb8a3089b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 200 len: 1613 microversion: 2.1 time: 0.115711 May 26 20:30:29.081978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 369/740] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:28 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 1613 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:29.125976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-9007a0ae-1ab5-4d3b-9700-cb0e9f4b4160 req-654fcfa6-302a-47ee-83ec-ec77f6c34ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6565432e-8214-4e00-84ca-525f7acc6c8c", "name": "network-vif-deleted", "tag": "e69ae7b9-16d9-473a-85f4-968fc5e64a24"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:29.137161 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-9007a0ae-1ab5-4d3b-9700-cb0e9f4b4160 req-654fcfa6-302a-47ee-83ec-ec77f6c34ee3 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:29.137848 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-9007a0ae-1ab5-4d3b-9700-cb0e9f4b4160 req-654fcfa6-302a-47ee-83ec-ec77f6c34ee3 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:29.154839 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-9007a0ae-1ab5-4d3b-9700-cb0e9f4b4160 req-654fcfa6-302a-47ee-83ec-ec77f6c34ee3 service nova] Creating event network-vif-deleted:e69ae7b9-16d9-473a-85f4-968fc5e64a24 for instance 6565432e-8214-4e00-84ca-525f7acc6c8c on hv-cinder-84213 May 26 20:30:29.164639 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-9007a0ae-1ab5-4d3b-9700-cb0e9f4b4160 req-654fcfa6-302a-47ee-83ec-ec77f6c34ee3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042982 May 26 20:30:29.166037 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 370/741] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:30:29.178786 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5bdff935-062c-427e-9df8-f478b7a2b1d4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:29.189326 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5bdff935-062c-427e-9df8-f478b7a2b1d4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:29.190969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5bdff935-062c-427e-9df8-f478b7a2b1d4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:29.192539 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5bdff935-062c-427e-9df8-f478b7a2b1d4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.206777 May 26 20:30:29.193288 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 372/742] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:28 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:30.100839 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4bf4167b-465c-430a-81a0-429ac5b98812 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:30.101551 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4bf4167b-465c-430a-81a0-429ac5b98812 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:30.108147 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4bf4167b-465c-430a-81a0-429ac5b98812 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:30.108602 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4bf4167b-465c-430a-81a0-429ac5b98812 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:30.109535 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4bf4167b-465c-430a-81a0-429ac5b98812 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:30.109979 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4bf4167b-465c-430a-81a0-429ac5b98812 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:30.124162 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-4bf4167b-465c-430a-81a0-429ac5b98812 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4bf4167b-465c-430a-81a0-429ac5b98812 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c HTTP/1.1 May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:30:30.126120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:30:30.127833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:30.127833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:30.127833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:30.127833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:30.127833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:30.127833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:30:30.127833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:30:30.127833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:30:30.127833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:30.127833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:30:30.127833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:30.127833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '6565432e-8214-4e00-84ca-525f7acc6c8c'} May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:30.128694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:30.130032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:30.131247 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4bf4167b-465c-430a-81a0-429ac5b98812 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 404 to user: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:30.131247 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4bf4167b-465c-430a-81a0-429ac5b98812 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 404 len: 111 microversion: 2.1 time: 0.031461 May 26 20:30:30.131247 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 371/743] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:30 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:30.136903 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6ddb639c-3767-442d-b3b0-c3906f36db18 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '.version_select at 0x7f2da443f8b0>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:30.208904 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6ddb639c-3767-442d-b3b0-c3906f36db18 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718127336" status: 202 len: 0 microversion: 2.1 time: 0.075652 May 26 20:30:30.209523 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 373/744] 10.222.0.44 () {58 vars in 1220 bytes} [Thu May 26 20:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718127336 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:30:30.213312 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-049c0466-c677-45b5-a4bb-84e9360d2ac8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:30.213849 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-049c0466-c677-45b5-a4bb-84e9360d2ac8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:30.221612 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-049c0466-c677-45b5-a4bb-84e9360d2ac8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:30.222127 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-049c0466-c677-45b5-a4bb-84e9360d2ac8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:30.222962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-049c0466-c677-45b5-a4bb-84e9360d2ac8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:30.223391 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-049c0466-c677-45b5-a4bb-84e9360d2ac8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:30.648891 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-049c0466-c677-45b5-a4bb-84e9360d2ac8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:30.657674 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-049c0466-c677-45b5-a4bb-84e9360d2ac8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:30.659028 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-049c0466-c677-45b5-a4bb-84e9360d2ac8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:30.660241 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-049c0466-c677-45b5-a4bb-84e9360d2ac8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.451689 May 26 20:30:30.660781 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 372/745] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:30 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:30:31.679008 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-08d50972-b29e-44e5-a6d6-5a867b376144 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:31.679611 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-08d50972-b29e-44e5-a6d6-5a867b376144 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:31.686476 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-08d50972-b29e-44e5-a6d6-5a867b376144 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:31.687707 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-08d50972-b29e-44e5-a6d6-5a867b376144 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:31.688395 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-08d50972-b29e-44e5-a6d6-5a867b376144 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:31.688818 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-08d50972-b29e-44e5-a6d6-5a867b376144 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:31.838992 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-08d50972-b29e-44e5-a6d6-5a867b376144 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:31.849082 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-08d50972-b29e-44e5-a6d6-5a867b376144 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:31.850623 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-08d50972-b29e-44e5-a6d6-5a867b376144 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:31.851802 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-08d50972-b29e-44e5-a6d6-5a867b376144 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1743 microversion: 2.20 time: 0.177257 May 26 20:30:31.852355 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 374/746] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:31 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:32.875130 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5e4e30fa-a24f-44c5-98b0-2fa05866cdcc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:32.875897 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5e4e30fa-a24f-44c5-98b0-2fa05866cdcc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:32.883066 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e4e30fa-a24f-44c5-98b0-2fa05866cdcc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:32.883816 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e4e30fa-a24f-44c5-98b0-2fa05866cdcc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:32.884844 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e4e30fa-a24f-44c5-98b0-2fa05866cdcc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:32.885277 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5e4e30fa-a24f-44c5-98b0-2fa05866cdcc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:32.998998 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-09c1e5c5-bb33-498f-b39d-4921c07faf45 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:32.999627 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-09c1e5c5-bb33-498f-b39d-4921c07faf45 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:33.006849 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-09c1e5c5-bb33-498f-b39d-4921c07faf45 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:33.007296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-09c1e5c5-bb33-498f-b39d-4921c07faf45 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:33.008064 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-09c1e5c5-bb33-498f-b39d-4921c07faf45 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:33.008495 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-09c1e5c5-bb33-498f-b39d-4921c07faf45 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:33.024523 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-09c1e5c5-bb33-498f-b39d-4921c07faf45 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-09c1e5c5-bb33-498f-b39d-4921c07faf45 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: DELETE /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c HTTP/1.1 May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:30:33.026207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:30:33.027789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:33.027789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:33.027789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:33.027789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:33.027789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:33.027789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:30:33.027789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:30:33.027789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:30:33.027789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:33.027789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:30:33.027789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:33.027789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '6565432e-8214-4e00-84ca-525f7acc6c8c'} May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:33.028601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:33.029913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:33.032833 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-09c1e5c5-bb33-498f-b39d-4921c07faf45 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 404 to user: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:33.032833 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-09c1e5c5-bb33-498f-b39d-4921c07faf45 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 404 len: 111 microversion: 2.1 time: 0.032515 May 26 20:30:33.032833 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 375/747] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:30:32 2022] DELETE /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 20:30:33.047480 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5e4e30fa-a24f-44c5-98b0-2fa05866cdcc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:33.056343 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-12186a35-bf3a-4e6d-8fcd-a0745122073b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:33.057001 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-12186a35-bf3a-4e6d-8fcd-a0745122073b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 6565432e-8214-4e00-84ca-525f7acc6c8c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:33.062206 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5e4e30fa-a24f-44c5-98b0-2fa05866cdcc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:33.063900 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12186a35-bf3a-4e6d-8fcd-a0745122073b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:33.064042 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5e4e30fa-a24f-44c5-98b0-2fa05866cdcc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:33.064353 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12186a35-bf3a-4e6d-8fcd-a0745122073b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:33.065127 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12186a35-bf3a-4e6d-8fcd-a0745122073b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:33.065414 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5e4e30fa-a24f-44c5-98b0-2fa05866cdcc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1743 microversion: 2.20 time: 0.196382 May 26 20:30:33.065564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12186a35-bf3a-4e6d-8fcd-a0745122073b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:33.065972 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 373/748] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:32 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1743 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:33.081196 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-12186a35-bf3a-4e6d-8fcd-a0745122073b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-12186a35-bf3a-4e6d-8fcd-a0745122073b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c HTTP/1.1 May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:30:33.082969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:30:33.084510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:33.084510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:33.084510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:33.084510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:33.084510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:33.084510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:30:33.084510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:30:33.084510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:30:33.084510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:33.084510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:30:33.084510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:33.084510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '6565432e-8214-4e00-84ca-525f7acc6c8c'} May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:33.085442 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. May 26 20:30:33.087101 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:33.088517 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-12186a35-bf3a-4e6d-8fcd-a0745122073b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 404 to user: Instance 6565432e-8214-4e00-84ca-525f7acc6c8c could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:33.088517 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-12186a35-bf3a-4e6d-8fcd-a0745122073b tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c" status: 404 len: 111 microversion: 2.1 time: 0.044472 May 26 20:30:33.088517 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 376/749] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:33 2022] GET /compute/v2.1/servers/6565432e-8214-4e00-84ca-525f7acc6c8c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:34.084684 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-61ed67a9-b336-4fc0-9ab5-a3adaf92f8f8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:34.085292 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-61ed67a9-b336-4fc0-9ab5-a3adaf92f8f8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:34.096711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61ed67a9-b336-4fc0-9ab5-a3adaf92f8f8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:34.097376 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61ed67a9-b336-4fc0-9ab5-a3adaf92f8f8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:34.099305 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61ed67a9-b336-4fc0-9ab5-a3adaf92f8f8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:34.099907 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-61ed67a9-b336-4fc0-9ab5-a3adaf92f8f8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:34.120500 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:30:34.293253 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-61ed67a9-b336-4fc0-9ab5-a3adaf92f8f8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:34.306451 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-61ed67a9-b336-4fc0-9ab5-a3adaf92f8f8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:34.308692 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-61ed67a9-b336-4fc0-9ab5-a3adaf92f8f8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:34.309851 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-61ed67a9-b336-4fc0-9ab5-a3adaf92f8f8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.229318 May 26 20:30:34.310730 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 374/750] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:34 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:34.438633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-28e63861-1345-4ac0-82cc-01e8ab3a42e3 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:34.439478 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-28e63861-1345-4ac0-82cc-01e8ab3a42e3 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:34.450187 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-28e63861-1345-4ac0-82cc-01e8ab3a42e3 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:34.451012 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-28e63861-1345-4ac0-82cc-01e8ab3a42e3 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:34.452642 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-28e63861-1345-4ac0-82cc-01e8ab3a42e3 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:34.454118 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-28e63861-1345-4ac0-82cc-01e8ab3a42e3 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:34.476309 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-28e63861-1345-4ac0-82cc-01e8ab3a42e3 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-28e63861-1345-4ac0-82cc-01e8ab3a42e3 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: DELETE /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a HTTP/1.1 May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:30:34.478314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:30:34.479811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:34.479811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:34.479811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:34.479811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:34.479811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:34.479811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:30:34.479811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:30:34.479811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:30:34.479811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:34.479811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:30:34.479811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:30:34.479811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '931728fa-007b-4441-97c1-602ae434cf8a'} May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:34.480527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:30:34.481716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:34.484955 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-28e63861-1345-4ac0-82cc-01e8ab3a42e3 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 404 to user: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:34.484955 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-28e63861-1345-4ac0-82cc-01e8ab3a42e3 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 404 len: 111 microversion: 2.1 time: 0.051085 May 26 20:30:34.485762 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 377/751] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:30:34 2022] DELETE /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:34.496298 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0e551c1b-7847-4516-9c8d-bdc22db27143 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:34.496298 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0e551c1b-7847-4516-9c8d-bdc22db27143 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 931728fa-007b-4441-97c1-602ae434cf8a] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:34.505239 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e551c1b-7847-4516-9c8d-bdc22db27143 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:34.505698 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e551c1b-7847-4516-9c8d-bdc22db27143 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:34.506774 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e551c1b-7847-4516-9c8d-bdc22db27143 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:34.507397 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0e551c1b-7847-4516-9c8d-bdc22db27143 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:34.527600 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-0e551c1b-7847-4516-9c8d-bdc22db27143 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0e551c1b-7847-4516-9c8d-bdc22db27143 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a HTTP/1.1 May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:30:34.529837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:30:34.531785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:34.531785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:34.531785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:34.531785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:34.531785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:34.531785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:30:34.531785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:30:34.531785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:30:34.531785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:34.531785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:30:34.531785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:30:34.531785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '931728fa-007b-4441-97c1-602ae434cf8a'} May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:34.532994 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. May 26 20:30:34.534520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:34.536833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0e551c1b-7847-4516-9c8d-bdc22db27143 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 404 to user: Instance 931728fa-007b-4441-97c1-602ae434cf8a could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:34.537717 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0e551c1b-7847-4516-9c8d-bdc22db27143 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a" status: 404 len: 111 microversion: 2.1 time: 0.047898 May 26 20:30:34.538474 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 375/752] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:34 2022] GET /compute/v2.1/servers/931728fa-007b-4441-97c1-602ae434cf8a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:34.549019 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-93f7d823-fe0d-4aed-a8d0-0520a0ab5536 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:34.549519 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-93f7d823-fe0d-4aed-a8d0-0520a0ab5536 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:34.562697 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-93f7d823-fe0d-4aed-a8d0-0520a0ab5536 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:34.563158 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-93f7d823-fe0d-4aed-a8d0-0520a0ab5536 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:34.563942 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-93f7d823-fe0d-4aed-a8d0-0520a0ab5536 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:34.564385 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-93f7d823-fe0d-4aed-a8d0-0520a0ab5536 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:34.605528 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-93f7d823-fe0d-4aed-a8d0-0520a0ab5536 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-93f7d823-fe0d-4aed-a8d0-0520a0ab5536 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: DELETE /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b HTTP/1.1 May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:30:34.631654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:30:34.633301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:34.633301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:34.633301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:34.633301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:34.633301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:34.633301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:30:34.633301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:30:34.633301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:30:34.633301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:34.633301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:30:34.633301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:30:34.633301 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '0e33194d-abb0-4789-9dd9-7a0cf235852b'} May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:34.634936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:30:34.640543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:34.644905 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-93f7d823-fe0d-4aed-a8d0-0520a0ab5536 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 404 to user: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:34.644905 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-93f7d823-fe0d-4aed-a8d0-0520a0ab5536 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 404 len: 111 microversion: 2.1 time: 0.064893 May 26 20:30:34.644905 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 378/753] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:30:34 2022] DELETE /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:34.645384 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a5fa9100-fd11-4058-83a9-04b255de12ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:34.645384 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a5fa9100-fd11-4058-83a9-04b255de12ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 0e33194d-abb0-4789-9dd9-7a0cf235852b] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:34.645384 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a5fa9100-fd11-4058-83a9-04b255de12ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:34.645384 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a5fa9100-fd11-4058-83a9-04b255de12ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:34.646031 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a5fa9100-fd11-4058-83a9-04b255de12ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:34.646031 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a5fa9100-fd11-4058-83a9-04b255de12ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:34.665315 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-a5fa9100-fd11-4058-83a9-04b255de12ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a5fa9100-fd11-4058-83a9-04b255de12ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b HTTP/1.1 May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:30:34.667079 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:30:34.668942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:34.668942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:34.668942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:34.668942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:34.668942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:34.668942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:30:34.668942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:30:34.668942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:30:34.668942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:34.668942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:30:34.668942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:30:34.668942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '0e33194d-abb0-4789-9dd9-7a0cf235852b'} May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:34.669802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. May 26 20:30:34.671992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:34.673476 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a5fa9100-fd11-4058-83a9-04b255de12ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 404 to user: Instance 0e33194d-abb0-4789-9dd9-7a0cf235852b could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:34.673476 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a5fa9100-fd11-4058-83a9-04b255de12ea tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b" status: 404 len: 111 microversion: 2.1 time: 0.053740 May 26 20:30:34.673476 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 376/754] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:34 2022] GET /compute/v2.1/servers/0e33194d-abb0-4789-9dd9-7a0cf235852b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:35.341093 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-65461ae7-53c0-4c85-a97e-293370e7119c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:35.342234 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-65461ae7-53c0-4c85-a97e-293370e7119c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:35.364271 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-65461ae7-53c0-4c85-a97e-293370e7119c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:35.368919 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-65461ae7-53c0-4c85-a97e-293370e7119c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:35.369954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-65461ae7-53c0-4c85-a97e-293370e7119c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:35.370643 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-65461ae7-53c0-4c85-a97e-293370e7119c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:35.561422 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-65461ae7-53c0-4c85-a97e-293370e7119c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:35.571225 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-65461ae7-53c0-4c85-a97e-293370e7119c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:35.575555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-65461ae7-53c0-4c85-a97e-293370e7119c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:35.575555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-65461ae7-53c0-4c85-a97e-293370e7119c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.241719 May 26 20:30:35.575555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 379/755] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:35 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:35.777949 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-77d8d36b-e75f-41eb-80f9-3af9bef76a17 req-c61e4c2c-cde0-4f66-9ffe-9e72101811ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419dd0d9-334f-4481-aa27-8c24115614db", "name": "network-vif-plugged", "status": "completed", "tag": "9ff1ecd8-c0e6-4014-b5c2-850b82d549df"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:35.789870 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-77d8d36b-e75f-41eb-80f9-3af9bef76a17 req-c61e4c2c-cde0-4f66-9ffe-9e72101811ca service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:35.790449 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-77d8d36b-e75f-41eb-80f9-3af9bef76a17 req-c61e4c2c-cde0-4f66-9ffe-9e72101811ca service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:35.807481 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-77d8d36b-e75f-41eb-80f9-3af9bef76a17 req-c61e4c2c-cde0-4f66-9ffe-9e72101811ca service nova] Creating event network-vif-plugged:9ff1ecd8-c0e6-4014-b5c2-850b82d549df for instance 419dd0d9-334f-4481-aa27-8c24115614db on hv-cinder-84213 May 26 20:30:35.813346 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-77d8d36b-e75f-41eb-80f9-3af9bef76a17 req-c61e4c2c-cde0-4f66-9ffe-9e72101811ca service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040944 May 26 20:30:35.814935 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 377/756] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:36.506008 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ff8032dd-55d2-4695-ae0a-d68cb51204f7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:36.506525 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ff8032dd-55d2-4695-ae0a-d68cb51204f7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:36.516246 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ff8032dd-55d2-4695-ae0a-d68cb51204f7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:36.516946 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ff8032dd-55d2-4695-ae0a-d68cb51204f7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:36.517925 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ff8032dd-55d2-4695-ae0a-d68cb51204f7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:36.518552 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ff8032dd-55d2-4695-ae0a-d68cb51204f7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:36.539013 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-ff8032dd-55d2-4695-ae0a-d68cb51204f7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ff8032dd-55d2-4695-ae0a-d68cb51204f7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: DELETE /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d HTTP/1.1 May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:30:36.540881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:30:36.542773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:36.542773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:36.542773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:36.542773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:36.542773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:36.542773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:30:36.542773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:30:36.542773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:30:36.542773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:36.542773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:30:36.542773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:30:36.542773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '91a2054d-de32-402c-8f6a-2f753925164d'} May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:36.543685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:30:36.545217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:36.548830 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ff8032dd-55d2-4695-ae0a-d68cb51204f7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 404 to user: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:36.552992 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ff8032dd-55d2-4695-ae0a-d68cb51204f7 tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "DELETE /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 404 len: 111 microversion: 2.1 time: 0.050948 May 26 20:30:36.554184 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 380/757] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:30:36 2022] DELETE /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:36.563890 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4c91cd07-e5dc-495c-8cc4-fe665af2729f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:36.564918 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4c91cd07-e5dc-495c-8cc4-fe665af2729f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] [instance: 91a2054d-de32-402c-8f6a-2f753925164d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:36.574322 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4c91cd07-e5dc-495c-8cc4-fe665af2729f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:36.575157 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4c91cd07-e5dc-495c-8cc4-fe665af2729f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:36.576397 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4c91cd07-e5dc-495c-8cc4-fe665af2729f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:36.579049 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4c91cd07-e5dc-495c-8cc4-fe665af2729f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:36.598013 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-631e09ac-2c38-4b91-b941-70fe3778b18f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:36.598013 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-631e09ac-2c38-4b91-b941-70fe3778b18f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:36.607072 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-631e09ac-2c38-4b91-b941-70fe3778b18f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:36.612226 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-631e09ac-2c38-4b91-b941-70fe3778b18f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:36.613429 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-4c91cd07-e5dc-495c-8cc4-fe665af2729f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] HTTP exception thrown: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:30:36.613971 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-631e09ac-2c38-4b91-b941-70fe3778b18f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:36.615749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-631e09ac-2c38-4b91-b941-70fe3778b18f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4c91cd07-e5dc-495c-8cc4-fe665af2729f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Request method failure captured: May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d HTTP/1.1 May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-IdN66x-R22e4SQiGTjbKqp0tI_zX6k4sTWmK6-MY3mEuEyb4p1OuymoeBEN2JHVjMxTbY8LdIKoF2ta1MzDR8tNbK7X08MSf0ixIuqi82Bsvu1YjhO57GLBBvEJ5BNCLbcyvCB6v3zMSZmXqLGiiIcgOiAi2JVQQKNtDXkU4fNYSg May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:30:36.616421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:30:36.617768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c09dea310ad24870bc5f20241f7f1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:36.617768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:36.617768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: c09dea310ad24870bc5f20241f7f1ad7 May 26 20:30:36.617768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666320588 May 26 20:30:36.617768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:36.617768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:30:36.617768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:30:36.617768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: f57c87dc60754d3aa87a84605c7a6889 May 26 20:30:36.617768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeNegativeTest-1666320588-project May 26 20:30:36.617768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:30:36.617768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:30:36.617768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '91a2054d-de32-402c-8f6a-2f753925164d'} May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:36.618593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. May 26 20:30:36.619796 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:36.623828 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4c91cd07-e5dc-495c-8cc4-fe665af2729f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] Returning 404 to user: Instance 91a2054d-de32-402c-8f6a-2f753925164d could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:36.626051 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4c91cd07-e5dc-495c-8cc4-fe665af2729f tempest-AttachVolumeNegativeTest-1666320588 tempest-AttachVolumeNegativeTest-1666320588-project] 10.222.0.44 "GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d" status: 404 len: 111 microversion: 2.1 time: 0.067663 May 26 20:30:36.627032 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 378/758] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:36 2022] GET /compute/v2.1/servers/91a2054d-de32-402c-8f6a-2f753925164d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:36.833698 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-631e09ac-2c38-4b91-b941-70fe3778b18f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:36.852320 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-631e09ac-2c38-4b91-b941-70fe3778b18f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:36.858154 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-631e09ac-2c38-4b91-b941-70fe3778b18f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:36.860000 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-631e09ac-2c38-4b91-b941-70fe3778b18f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.270684 May 26 20:30:36.860546 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 381/759] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:36 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:37.893260 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-78801a47-ddc5-44f3-b6fa-54bc1d610c5e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:37.894658 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-78801a47-ddc5-44f3-b6fa-54bc1d610c5e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:37.920250 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78801a47-ddc5-44f3-b6fa-54bc1d610c5e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:37.922005 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78801a47-ddc5-44f3-b6fa-54bc1d610c5e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:37.922856 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78801a47-ddc5-44f3-b6fa-54bc1d610c5e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:37.923378 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-78801a47-ddc5-44f3-b6fa-54bc1d610c5e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:38.113223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-78801a47-ddc5-44f3-b6fa-54bc1d610c5e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:38.121624 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-78801a47-ddc5-44f3-b6fa-54bc1d610c5e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:38.123194 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-78801a47-ddc5-44f3-b6fa-54bc1d610c5e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:38.124517 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-78801a47-ddc5-44f3-b6fa-54bc1d610c5e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.246664 May 26 20:30:38.125086 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 379/760] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:37 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:39.148454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-fef4fe86-1c18-4012-bf4c-26377ef1bea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:39.149068 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-fef4fe86-1c18-4012-bf4c-26377ef1bea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:39.157985 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fef4fe86-1c18-4012-bf4c-26377ef1bea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:39.179947 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fef4fe86-1c18-4012-bf4c-26377ef1bea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:39.181069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fef4fe86-1c18-4012-bf4c-26377ef1bea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:39.182777 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fef4fe86-1c18-4012-bf4c-26377ef1bea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:39.623059 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-fef4fe86-1c18-4012-bf4c-26377ef1bea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:39.638151 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-fef4fe86-1c18-4012-bf4c-26377ef1bea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:39.640638 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-fef4fe86-1c18-4012-bf4c-26377ef1bea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:39.645046 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-fef4fe86-1c18-4012-bf4c-26377ef1bea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.506227 May 26 20:30:39.651393 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 382/761] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:39 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:40.673581 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e51b126c-cb07-4518-8b04-399dcbb33505 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:40.681621 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e51b126c-cb07-4518-8b04-399dcbb33505 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:40.689322 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e51b126c-cb07-4518-8b04-399dcbb33505 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:40.696345 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e51b126c-cb07-4518-8b04-399dcbb33505 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:40.697428 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e51b126c-cb07-4518-8b04-399dcbb33505 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:40.698034 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e51b126c-cb07-4518-8b04-399dcbb33505 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:40.986137 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e51b126c-cb07-4518-8b04-399dcbb33505 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:40.997327 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e51b126c-cb07-4518-8b04-399dcbb33505 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:41.003375 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e51b126c-cb07-4518-8b04-399dcbb33505 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:41.005674 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e51b126c-cb07-4518-8b04-399dcbb33505 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.345182 May 26 20:30:41.006590 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 380/762] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:40 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:42.025223 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-59993ccb-93af-441d-ac65-0bd8fc9f8c15 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:42.026524 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-59993ccb-93af-441d-ac65-0bd8fc9f8c15 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:42.037366 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-59993ccb-93af-441d-ac65-0bd8fc9f8c15 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:42.040542 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-59993ccb-93af-441d-ac65-0bd8fc9f8c15 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:42.043902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-59993ccb-93af-441d-ac65-0bd8fc9f8c15 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:42.044293 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-59993ccb-93af-441d-ac65-0bd8fc9f8c15 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:42.331399 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-59993ccb-93af-441d-ac65-0bd8fc9f8c15 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:42.344821 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-59993ccb-93af-441d-ac65-0bd8fc9f8c15 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:42.349719 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-59993ccb-93af-441d-ac65-0bd8fc9f8c15 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:42.358902 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-59993ccb-93af-441d-ac65-0bd8fc9f8c15 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.337549 May 26 20:30:42.359970 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 383/763] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:42 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:43.378776 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e2c18e04-9faa-4959-bc86-6cf33c87fbeb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:43.379442 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e2c18e04-9faa-4959-bc86-6cf33c87fbeb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:43.385907 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e2c18e04-9faa-4959-bc86-6cf33c87fbeb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:43.386390 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e2c18e04-9faa-4959-bc86-6cf33c87fbeb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:43.387150 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e2c18e04-9faa-4959-bc86-6cf33c87fbeb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:43.387584 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e2c18e04-9faa-4959-bc86-6cf33c87fbeb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:43.528886 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e2c18e04-9faa-4959-bc86-6cf33c87fbeb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:43.540977 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e2c18e04-9faa-4959-bc86-6cf33c87fbeb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:43.542528 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e2c18e04-9faa-4959-bc86-6cf33c87fbeb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:43.543944 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e2c18e04-9faa-4959-bc86-6cf33c87fbeb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.169492 May 26 20:30:43.544504 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 381/764] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:43 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:44.564602 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-77e515cb-cb8a-47d2-a835-98c82299b9ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:44.566809 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-77e515cb-cb8a-47d2-a835-98c82299b9ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:44.575265 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-77e515cb-cb8a-47d2-a835-98c82299b9ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:44.575999 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-77e515cb-cb8a-47d2-a835-98c82299b9ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:44.576940 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-77e515cb-cb8a-47d2-a835-98c82299b9ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:44.577722 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-77e515cb-cb8a-47d2-a835-98c82299b9ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:44.867098 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-77e515cb-cb8a-47d2-a835-98c82299b9ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:44.883670 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-77e515cb-cb8a-47d2-a835-98c82299b9ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:44.884404 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-77e515cb-cb8a-47d2-a835-98c82299b9ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:44.885586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-77e515cb-cb8a-47d2-a835-98c82299b9ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.326782 May 26 20:30:44.887089 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 384/765] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:44 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:44.912406 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-66130d12-e411-40a9-b187-5bee3c715768 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2107456738"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:44.914726 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-66130d12-e411-40a9-b187-5bee3c715768 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:44.924495 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66130d12-e411-40a9-b187-5bee3c715768 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:44.925223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66130d12-e411-40a9-b187-5bee3c715768 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:44.926455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66130d12-e411-40a9-b187-5bee3c715768 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:44.927047 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66130d12-e411-40a9-b187-5bee3c715768 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:45.135904 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.network.security_group_api [None req-66130d12-e411-40a9-b187-5bee3c715768 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Removing security group 1d90443c-fd20-4c27-b01e-7f825fc21bb1 from port a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d May 26 20:30:45.824855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-66130d12-e411-40a9-b187-5bee3c715768 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "POST /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/action" status: 202 len: 0 microversion: 2.1 time: 0.910907 May 26 20:30:45.830995 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 382/766] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:30:44 2022] POST /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/action => generated 0 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:30:45.837783 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-8517f515-4fd7-482f-bf57-697b5691fcc5 req-1f1ec29f-1ab3-44ce-9a0a-58a9e8f49e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6f1ba5-371c-4465-8534-2eb1ef60acdb", "tag": "a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:45.859961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-8517f515-4fd7-482f-bf57-697b5691fcc5 req-1f1ec29f-1ab3-44ce-9a0a-58a9e8f49e3d service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:45.861970 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-8517f515-4fd7-482f-bf57-697b5691fcc5 req-1f1ec29f-1ab3-44ce-9a0a-58a9e8f49e3d service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:45.907610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ce6bebf1-21c3-4523-a01f-9ea2e103fe24 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:45.908597 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ce6bebf1-21c3-4523-a01f-9ea2e103fe24 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:45.914404 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-8517f515-4fd7-482f-bf57-697b5691fcc5 req-1f1ec29f-1ab3-44ce-9a0a-58a9e8f49e3d service nova] Creating event network-changed:a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d for instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb on hv-cinder-84213 May 26 20:30:45.923736 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ce6bebf1-21c3-4523-a01f-9ea2e103fe24 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:45.931782 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ce6bebf1-21c3-4523-a01f-9ea2e103fe24 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:45.939526 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ce6bebf1-21c3-4523-a01f-9ea2e103fe24 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:45.944313 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-8517f515-4fd7-482f-bf57-697b5691fcc5 req-1f1ec29f-1ab3-44ce-9a0a-58a9e8f49e3d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130552 May 26 20:30:45.946636 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ce6bebf1-21c3-4523-a01f-9ea2e103fe24 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:45.951568 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 385/767] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:46.308739 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ce6bebf1-21c3-4523-a01f-9ea2e103fe24 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:46.324862 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ce6bebf1-21c3-4523-a01f-9ea2e103fe24 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:46.327953 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ce6bebf1-21c3-4523-a01f-9ea2e103fe24 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:46.330266 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ce6bebf1-21c3-4523-a01f-9ea2e103fe24 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.429851 May 26 20:30:46.333296 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 383/768] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:45 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:30:47.361504 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5d0f8fe6-a69e-49d4-9f8a-758b7e393c13 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:47.363323 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5d0f8fe6-a69e-49d4-9f8a-758b7e393c13 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:47.402063 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5d0f8fe6-a69e-49d4-9f8a-758b7e393c13 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:47.402896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5d0f8fe6-a69e-49d4-9f8a-758b7e393c13 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:47.404833 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5d0f8fe6-a69e-49d4-9f8a-758b7e393c13 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:47.405644 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5d0f8fe6-a69e-49d4-9f8a-758b7e393c13 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:47.752839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5d0f8fe6-a69e-49d4-9f8a-758b7e393c13 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:47.759263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:30:47.766799 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5d0f8fe6-a69e-49d4-9f8a-758b7e393c13 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:47.769234 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5d0f8fe6-a69e-49d4-9f8a-758b7e393c13 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:47.770948 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5d0f8fe6-a69e-49d4-9f8a-758b7e393c13 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.415267 May 26 20:30:47.784169 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 386/769] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:47 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:48.596251 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b5c1787c-728c-42e8-9355-4bb0013f63d1 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:48.596832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b5c1787c-728c-42e8-9355-4bb0013f63d1 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:48.598682 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-05c06ae0-1091-4c17-82eb-81fefc8e554f req-503f88ec-9e9f-44c8-afa2-5c39db5ba396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6f1ba5-371c-4465-8534-2eb1ef60acdb", "tag": "a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:48.603245 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5c1787c-728c-42e8-9355-4bb0013f63d1 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:48.603913 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5c1787c-728c-42e8-9355-4bb0013f63d1 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:48.604691 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5c1787c-728c-42e8-9355-4bb0013f63d1 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:48.605132 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b5c1787c-728c-42e8-9355-4bb0013f63d1 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:48.609192 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-05c06ae0-1091-4c17-82eb-81fefc8e554f req-503f88ec-9e9f-44c8-afa2-5c39db5ba396 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:48.609882 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-05c06ae0-1091-4c17-82eb-81fefc8e554f req-503f88ec-9e9f-44c8-afa2-5c39db5ba396 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:48.621364 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-05c06ae0-1091-4c17-82eb-81fefc8e554f req-503f88ec-9e9f-44c8-afa2-5c39db5ba396 service nova] Creating event network-changed:a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d for instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb on hv-cinder-84213 May 26 20:30:48.626453 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-05c06ae0-1091-4c17-82eb-81fefc8e554f req-503f88ec-9e9f-44c8-afa2-5c39db5ba396 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031644 May 26 20:30:48.627276 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 387/770] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:30:48.697699 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-b5c1787c-728c-42e8-9355-4bb0013f63d1 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lazy-loading 'services' on Instance uuid 6f6f1ba5-371c-4465-8534-2eb1ef60acdb {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:30:48.793764 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2a4167be-bdb6-4d41-81a5-70af1be13f1a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:48.794659 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2a4167be-bdb6-4d41-81a5-70af1be13f1a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:48.801630 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2a4167be-bdb6-4d41-81a5-70af1be13f1a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:48.802422 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2a4167be-bdb6-4d41-81a5-70af1be13f1a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:48.803275 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2a4167be-bdb6-4d41-81a5-70af1be13f1a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:48.803836 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2a4167be-bdb6-4d41-81a5-70af1be13f1a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:48.966542 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2a4167be-bdb6-4d41-81a5-70af1be13f1a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:48.987771 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2a4167be-bdb6-4d41-81a5-70af1be13f1a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:48.996258 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2a4167be-bdb6-4d41-81a5-70af1be13f1a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:48.999164 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2a4167be-bdb6-4d41-81a5-70af1be13f1a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.209723 May 26 20:30:49.008136 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 388/771] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:48 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:30:49.311001 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b5c1787c-728c-42e8-9355-4bb0013f63d1 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments/0454e8ac-031a-4836-b540-e9c22c6130e1" status: 202 len: 0 microversion: 2.1 time: 0.719444 May 26 20:30:49.316360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 384/772] 10.222.0.44 () {58 vars in 1415 bytes} [Thu May 26 20:30:48 2022] DELETE /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments/0454e8ac-031a-4836-b540-e9c22c6130e1 => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:30:49.322235 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-289362da-693a-49f2-bf62-7f70fe3cf589 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:49.323529 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-289362da-693a-49f2-bf62-7f70fe3cf589 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:49.337033 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-289362da-693a-49f2-bf62-7f70fe3cf589 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:49.338490 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-289362da-693a-49f2-bf62-7f70fe3cf589 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:49.341261 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-289362da-693a-49f2-bf62-7f70fe3cf589 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:49.344217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-289362da-693a-49f2-bf62-7f70fe3cf589 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:49.391168 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-289362da-693a-49f2-bf62-7f70fe3cf589 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073134 May 26 20:30:49.399564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 389/773] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:30:49 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:50.022209 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c44bc6bd-3ffc-4ba4-93bd-22f4f70f152e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:50.023674 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c44bc6bd-3ffc-4ba4-93bd-22f4f70f152e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:50.050452 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c44bc6bd-3ffc-4ba4-93bd-22f4f70f152e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:50.050924 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c44bc6bd-3ffc-4ba4-93bd-22f4f70f152e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:50.051726 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c44bc6bd-3ffc-4ba4-93bd-22f4f70f152e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:50.052175 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c44bc6bd-3ffc-4ba4-93bd-22f4f70f152e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:50.286160 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c44bc6bd-3ffc-4ba4-93bd-22f4f70f152e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:50.294137 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c44bc6bd-3ffc-4ba4-93bd-22f4f70f152e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:50.295670 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c44bc6bd-3ffc-4ba4-93bd-22f4f70f152e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:50.297496 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c44bc6bd-3ffc-4ba4-93bd-22f4f70f152e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1738 microversion: 2.20 time: 0.279990 May 26 20:30:50.298161 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 385/774] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:50 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:30:50.405321 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-34aa6e53-f935-45c1-9a48-29ef278bdf35 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:50.406871 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-34aa6e53-f935-45c1-9a48-29ef278bdf35 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:50.413487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-34aa6e53-f935-45c1-9a48-29ef278bdf35 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:50.413933 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-34aa6e53-f935-45c1-9a48-29ef278bdf35 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:50.414748 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-34aa6e53-f935-45c1-9a48-29ef278bdf35 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:50.415187 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-34aa6e53-f935-45c1-9a48-29ef278bdf35 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:50.445476 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-34aa6e53-f935-45c1-9a48-29ef278bdf35 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 May 26 20:30:50.446022 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 390/775] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:30:50 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:30:51.318335 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c7c408f1-2a7b-495e-91be-3be5c30a25a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:51.319397 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c7c408f1-2a7b-495e-91be-3be5c30a25a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:51.326112 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c7c408f1-2a7b-495e-91be-3be5c30a25a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:51.326616 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c7c408f1-2a7b-495e-91be-3be5c30a25a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:51.327472 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c7c408f1-2a7b-495e-91be-3be5c30a25a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:51.327981 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c7c408f1-2a7b-495e-91be-3be5c30a25a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:51.461562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-d0a752ae-b4aa-43e5-baa4-efce0652b68c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:51.461562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-d0a752ae-b4aa-43e5-baa4-efce0652b68c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:51.480357 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d0a752ae-b4aa-43e5-baa4-efce0652b68c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:51.481645 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d0a752ae-b4aa-43e5-baa4-efce0652b68c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:51.484499 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d0a752ae-b4aa-43e5-baa4-efce0652b68c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:51.485436 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-d0a752ae-b4aa-43e5-baa4-efce0652b68c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:51.524348 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-d0a752ae-b4aa-43e5-baa4-efce0652b68c tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070407 May 26 20:30:51.529814 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 391/776] 10.222.0.44 () {58 vars in 1301 bytes} [Thu May 26 20:30:51 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 20:30:51.533182 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c7c408f1-2a7b-495e-91be-3be5c30a25a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:51.535859 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8dfe461c-8e29-44ca-947c-f176969e526e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:51.536832 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8dfe461c-8e29-44ca-947c-f176969e526e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:51.541470 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c7c408f1-2a7b-495e-91be-3be5c30a25a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:51.548357 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8dfe461c-8e29-44ca-947c-f176969e526e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:51.548505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c7c408f1-2a7b-495e-91be-3be5c30a25a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:51.548616 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8dfe461c-8e29-44ca-947c-f176969e526e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:51.548710 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c7c408f1-2a7b-495e-91be-3be5c30a25a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1720 microversion: 2.20 time: 0.231417 May 26 20:30:51.548812 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8dfe461c-8e29-44ca-947c-f176969e526e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:51.548812 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8dfe461c-8e29-44ca-947c-f176969e526e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:51.549003 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 386/777] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:51 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:51.638456 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-8dfe461c-8e29-44ca-947c-f176969e526e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] HTTP exception thrown: Instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb is not attached to volume 0454e8ac-031a-4836-b540-e9c22c6130e1 May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8dfe461c-8e29-44ca-947c-f176969e526e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Request method failure captured: May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: DELETE /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments/0454e8ac-031a-4836-b540-e9c22c6130e1 HTTP/1.1 May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-LDmtovUkXnwMIQYE-SW9i2DZZX8Vqr7zabuA8-WGIOaKOWn8Sk16gk0KWfxM1uuESWXPp1OjIcgyD-4kgKpO5KfHrzghKJqnLfm8TrRzSiRxIu_YSQukQVn9xq7NtoqpcyRGdvlsHrG7alTr6SNoT6Obk5OM_AVgA2gxBBhnT4p1Y May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: 437e2c484c1d4accb95b3787fd921363 May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-TestMinimumBasicScenario-1460194478 May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:30:51.642384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:30:51.643780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/437e2c484c1d4accb95b3787fd921363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/437e2c484c1d4accb95b3787fd921363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_437e2c484c1d4accb95b3787fd921363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/437e2c484c1d4accb95b3787fd921363"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:51.643780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-TestMinimumBasicScenario-1460194478 May 26 20:30:51.643780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: 437e2c484c1d4accb95b3787fd921363 May 26 20:30:51.643780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1460194478 May 26 20:30:51.643780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-TestMinimumBasicScenario-1460194478-project May 26 20:30:51.643780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:30:51.643780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:30:51.643780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: 0218a775ec8d415f924b34bcd40f87e6 May 26 20:30:51.643780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-TestMinimumBasicScenario-1460194478-project May 26 20:30:51.643780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:30:51.643780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb is not attached to volume 0454e8ac-031a-4836-b540-e9c22c6130e1 May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'server_id': '6f6f1ba5-371c-4465-8534-2eb1ef60acdb', 'id': '0454e8ac-031a-4836-b540-e9c22c6130e1'} May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0454e8ac-031a-4836-b540-e9c22c6130e1. May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:51.644551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb is not attached to volume 0454e8ac-031a-4836-b540-e9c22c6130e1 May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb is not attached to volume 0454e8ac-031a-4836-b540-e9c22c6130e1 May 26 20:30:51.645839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:30:51.648237 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8dfe461c-8e29-44ca-947c-f176969e526e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Returning 404 to user: Instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb is not attached to volume 0454e8ac-031a-4836-b540-e9c22c6130e1 {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:51.649252 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8dfe461c-8e29-44ca-947c-f176969e526e tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments/0454e8ac-031a-4836-b540-e9c22c6130e1" status: 404 len: 154 microversion: 2.1 time: 0.117408 May 26 20:30:51.650146 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 392/778] 10.222.0.44 () {58 vars in 1415 bytes} [Thu May 26 20:30:51 2022] DELETE /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb/os-volume_attachments/0454e8ac-031a-4836-b540-e9c22c6130e1 => generated 154 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:30:52.565093 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-05f16296-b1c2-45e2-8a87-670e7b577dfe tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:52.566316 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-05f16296-b1c2-45e2-8a87-670e7b577dfe tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:52.573531 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05f16296-b1c2-45e2-8a87-670e7b577dfe tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:52.573647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05f16296-b1c2-45e2-8a87-670e7b577dfe tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:52.574449 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05f16296-b1c2-45e2-8a87-670e7b577dfe tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:52.574888 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05f16296-b1c2-45e2-8a87-670e7b577dfe tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:52.728347 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-05f16296-b1c2-45e2-8a87-670e7b577dfe tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:52.739926 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-05f16296-b1c2-45e2-8a87-670e7b577dfe tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:52.743886 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-05f16296-b1c2-45e2-8a87-670e7b577dfe tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:52.745392 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-05f16296-b1c2-45e2-8a87-670e7b577dfe tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1720 microversion: 2.20 time: 0.184250 May 26 20:30:52.745962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 387/779] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:52 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:30:52.996413 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-71a9d3e4-85cf-4d90-b3bf-5cb1086a276a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:52.996913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-71a9d3e4-85cf-4d90-b3bf-5cb1086a276a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:53.003892 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-71a9d3e4-85cf-4d90-b3bf-5cb1086a276a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:53.004346 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-71a9d3e4-85cf-4d90-b3bf-5cb1086a276a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:53.005110 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-71a9d3e4-85cf-4d90-b3bf-5cb1086a276a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:53.005545 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-71a9d3e4-85cf-4d90-b3bf-5cb1086a276a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:53.031855 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-71a9d3e4-85cf-4d90-b3bf-5cb1086a276a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Going to try to terminate instance {{(pid=118306) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:30:53.342583 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-71a9d3e4-85cf-4d90-b3bf-5cb1086a276a tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 204 len: 0 microversion: 2.1 time: 0.345234 May 26 20:30:53.342583 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 393/780] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:30:52 2022] DELETE /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:30:53.348025 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f0c8fb7d-b1d0-483c-a3c7-9ff782ff26be tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:53.348716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f0c8fb7d-b1d0-483c-a3c7-9ff782ff26be tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:53.355044 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0c8fb7d-b1d0-483c-a3c7-9ff782ff26be tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:53.355527 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0c8fb7d-b1d0-483c-a3c7-9ff782ff26be tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:53.356576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0c8fb7d-b1d0-483c-a3c7-9ff782ff26be tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:53.357209 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0c8fb7d-b1d0-483c-a3c7-9ff782ff26be tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:53.522299 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f0c8fb7d-b1d0-483c-a3c7-9ff782ff26be tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:53.530869 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f0c8fb7d-b1d0-483c-a3c7-9ff782ff26be tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1553 microversion: 2.1 time: 0.186265 May 26 20:30:53.532033 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 388/781] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:53 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:53.769485 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-016d0b5e-d9a6-4e6e-94f2-d130257afa9c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:53.770185 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-016d0b5e-d9a6-4e6e-94f2-d130257afa9c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:53.776220 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-016d0b5e-d9a6-4e6e-94f2-d130257afa9c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:53.776669 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-016d0b5e-d9a6-4e6e-94f2-d130257afa9c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:53.777461 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-016d0b5e-d9a6-4e6e-94f2-d130257afa9c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:53.777893 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-016d0b5e-d9a6-4e6e-94f2-d130257afa9c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:53.919316 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-016d0b5e-d9a6-4e6e-94f2-d130257afa9c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:53.928455 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-016d0b5e-d9a6-4e6e-94f2-d130257afa9c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:53.930048 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-016d0b5e-d9a6-4e6e-94f2-d130257afa9c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:53.931202 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-016d0b5e-d9a6-4e6e-94f2-d130257afa9c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1720 microversion: 2.20 time: 0.166012 May 26 20:30:53.931746 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 394/782] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:53 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:54.540158 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-32998479", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "networks": [{"uuid": "1dc13164-6bce-4218-9ce4-99825b65cbe5"}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:54.549319 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ac13b3cd-ccaa-4f0b-bc47-a8413dd55c48 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:54.550551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ac13b3cd-ccaa-4f0b-bc47-a8413dd55c48 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:54.557033 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ac13b3cd-ccaa-4f0b-bc47-a8413dd55c48 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:54.562351 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ac13b3cd-ccaa-4f0b-bc47-a8413dd55c48 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:54.562351 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ac13b3cd-ccaa-4f0b-bc47-a8413dd55c48 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:54.562351 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ac13b3cd-ccaa-4f0b-bc47-a8413dd55c48 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:54.713364 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ac13b3cd-ccaa-4f0b-bc47-a8413dd55c48 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:54.722225 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ac13b3cd-ccaa-4f0b-bc47-a8413dd55c48 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1553 microversion: 2.1 time: 0.177186 May 26 20:30:54.728993 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 395/783] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:54 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:30:54.762623 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] validate_networks() for [('1dc13164-6bce-4218-9ce4-99825b65cbe5', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:30:54.948978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7fc3ac83-7edd-4edd-8957-d84a8bc1ec55 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:54.949585 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7fc3ac83-7edd-4edd-8957-d84a8bc1ec55 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:54.956165 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7fc3ac83-7edd-4edd-8957-d84a8bc1ec55 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:54.956607 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7fc3ac83-7edd-4edd-8957-d84a8bc1ec55 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:54.957368 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7fc3ac83-7edd-4edd-8957-d84a8bc1ec55 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:54.957798 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7fc3ac83-7edd-4edd-8957-d84a8bc1ec55 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:55.091405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7fc3ac83-7edd-4edd-8957-d84a8bc1ec55 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:55.100628 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7fc3ac83-7edd-4edd-8957-d84a8bc1ec55 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:55.102441 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7fc3ac83-7edd-4edd-8957-d84a8bc1ec55 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:55.104005 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7fc3ac83-7edd-4edd-8957-d84a8bc1ec55 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1720 microversion: 2.20 time: 0.158943 May 26 20:30:55.115749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 396/784] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:54 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:30:55.125859 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:30:55.126311 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:30:55.127138 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:30:55.127710 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:30:55.128144 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:30:55.137041 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:55.137541 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:55.138382 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:55.138817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:55.162571 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Getting quotas for project a13ea01e975047a7b1b04abfe3fd9e2b. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:30:55.167297 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Getting quotas for user 74b6cb4022ad4492acde4d6ecf39773a and project a13ea01e975047a7b1b04abfe3fd9e2b. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:30:55.182094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:30:55.187743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:30:55.325424 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-692dcfc8-7d25-4acd-97ee-d7b867024b1c tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789020 May 26 20:30:55.326823 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 389/785] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:30:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:30:55.337712 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-f7fc99d9-e99f-4c60-b338-417b70f90eed tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:55.338360 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-f7fc99d9-e99f-4c60-b338-417b70f90eed tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:55.439751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-f7fc99d9-e99f-4c60-b338-417b70f90eed tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:55.464044 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-f7fc99d9-e99f-4c60-b338-417b70f90eed tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1212 microversion: 2.1 time: 0.130289 May 26 20:30:55.465065 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 397/786] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:55 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1212 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:55.741827 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6e7fb808-855f-4c8c-9e24-c06c22f906ad tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:55.743259 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6e7fb808-855f-4c8c-9e24-c06c22f906ad tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:55.753204 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e7fb808-855f-4c8c-9e24-c06c22f906ad tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:55.755684 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e7fb808-855f-4c8c-9e24-c06c22f906ad tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:55.755684 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e7fb808-855f-4c8c-9e24-c06c22f906ad tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:55.755684 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6e7fb808-855f-4c8c-9e24-c06c22f906ad tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:55.854511 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-20163348-e970-4006-a18f-9a461d014758 req-27b0efa9-8c60-425b-b32f-4b98136a3568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419dd0d9-334f-4481-aa27-8c24115614db", "name": "network-vif-unplugged", "status": "completed", "tag": "9ff1ecd8-c0e6-4014-b5c2-850b82d549df"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:55.866400 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:30:55.868927 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6e7fb808-855f-4c8c-9e24-c06c22f906ad tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:55.885072 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-20163348-e970-4006-a18f-9a461d014758 req-27b0efa9-8c60-425b-b32f-4b98136a3568 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:55.885527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-20163348-e970-4006-a18f-9a461d014758 req-27b0efa9-8c60-425b-b32f-4b98136a3568 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:55.889721 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6e7fb808-855f-4c8c-9e24-c06c22f906ad tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1511 microversion: 2.1 time: 0.150956 May 26 20:30:55.890108 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 390/787] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:55 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:55.920134 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.compute.server_external_events [req-20163348-e970-4006-a18f-9a461d014758 req-27b0efa9-8c60-425b-b32f-4b98136a3568 service nova] Unable to find a host for instance 419dd0d9-334f-4481-aa27-8c24115614db. Dropping event network-vif-unplugged {{(pid=118306) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 20:30:55.922623 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-20163348-e970-4006-a18f-9a461d014758 req-27b0efa9-8c60-425b-b32f-4b98136a3568 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.077270 May 26 20:30:55.925198 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 398/788] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 81 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 20:30:55.933849 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-6e0c5ee5-574a-46f8-8c9e-753f7fc33b84 req-f9be5eb4-2a5d-4fe6-9e4f-85fbf9b87959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6f1ba5-371c-4465-8534-2eb1ef60acdb", "name": "network-vif-deleted", "tag": "a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:55.945269 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-6e0c5ee5-574a-46f8-8c9e-753f7fc33b84 req-f9be5eb4-2a5d-4fe6-9e4f-85fbf9b87959 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:55.945722 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-6e0c5ee5-574a-46f8-8c9e-753f7fc33b84 req-f9be5eb4-2a5d-4fe6-9e4f-85fbf9b87959 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:55.962018 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-6e0c5ee5-574a-46f8-8c9e-753f7fc33b84 req-f9be5eb4-2a5d-4fe6-9e4f-85fbf9b87959 service nova] Creating event network-vif-deleted:a5b4d80b-0e37-4bc0-8d99-d44ee1e6bc4d for instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb on hv-cinder-84213 May 26 20:30:55.967219 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-6e0c5ee5-574a-46f8-8c9e-753f7fc33b84 req-f9be5eb4-2a5d-4fe6-9e4f-85fbf9b87959 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037839 May 26 20:30:55.968555 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 391/789] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:30:56.125770 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-424a19b0-ad6d-4e02-bd78-52fb0935873b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:56.126719 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-424a19b0-ad6d-4e02-bd78-52fb0935873b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:56.139614 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-424a19b0-ad6d-4e02-bd78-52fb0935873b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:56.140398 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-424a19b0-ad6d-4e02-bd78-52fb0935873b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:56.141172 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-424a19b0-ad6d-4e02-bd78-52fb0935873b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:56.141837 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-424a19b0-ad6d-4e02-bd78-52fb0935873b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:56.324502 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-424a19b0-ad6d-4e02-bd78-52fb0935873b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:56.343982 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-424a19b0-ad6d-4e02-bd78-52fb0935873b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:56.347837 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-424a19b0-ad6d-4e02-bd78-52fb0935873b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:56.347837 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-424a19b0-ad6d-4e02-bd78-52fb0935873b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1663 microversion: 2.20 time: 0.226747 May 26 20:30:56.349091 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 399/790] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:56 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1663 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:56.367996 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2f59bd90-f255-416c-bbc9-3e5a38226740 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02c2b962-e262-478e-b7f5-b7f3bea203c8"}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:56.369279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2f59bd90-f255-416c-bbc9-3e5a38226740 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:56.376382 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2f59bd90-f255-416c-bbc9-3e5a38226740 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:56.377033 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2f59bd90-f255-416c-bbc9-3e5a38226740 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:56.377822 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2f59bd90-f255-416c-bbc9-3e5a38226740 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:56.378275 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2f59bd90-f255-416c-bbc9-3e5a38226740 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:56.480954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-adb77316-132a-4890-9f19-d60c2ecbf4b3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:56.481725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-adb77316-132a-4890-9f19-d60c2ecbf4b3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:56.546207 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-adb77316-132a-4890-9f19-d60c2ecbf4b3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:56.553132 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-adb77316-132a-4890-9f19-d60c2ecbf4b3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1212 microversion: 2.1 time: 0.076081 May 26 20:30:56.557329 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 400/791] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:56 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:30:56.916089 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-4a26e454-84e0-4ca0-aa16-f3958f8f19f8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:56.917698 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-4a26e454-84e0-4ca0-aa16-f3958f8f19f8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:56.928676 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4a26e454-84e0-4ca0-aa16-f3958f8f19f8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:56.929123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4a26e454-84e0-4ca0-aa16-f3958f8f19f8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:56.930979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4a26e454-84e0-4ca0-aa16-f3958f8f19f8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:56.931415 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4a26e454-84e0-4ca0-aa16-f3958f8f19f8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:56.967828 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4a26e454-84e0-4ca0-aa16-f3958f8f19f8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:56.968413 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-4a26e454-84e0-4ca0-aa16-f3958f8f19f8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:56.968910 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-4a26e454-84e0-4ca0-aa16-f3958f8f19f8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lazy-loading 'fault' on Instance uuid 6f6f1ba5-371c-4465-8534-2eb1ef60acdb {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:30:57.018520 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-4a26e454-84e0-4ca0-aa16-f3958f8f19f8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218a775ec8d415f924b34bcd40f87e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e2c484c1d4accb95b3787fd921363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:57.026524 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-4a26e454-84e0-4ca0-aa16-f3958f8f19f8 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 200 len: 1347 microversion: 2.1 time: 0.116070 May 26 20:30:57.027142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 401/792] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:56 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 1347 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:30:57.136351 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:30:57.493169 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2f59bd90-f255-416c-bbc9-3e5a38226740 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "POST /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.131014 May 26 20:30:57.493983 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 392/793] 10.222.0.44 () {62 vars in 1363 bytes} [Thu May 26 20:30:56 2022] POST /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/os-volume_attachments => generated 188 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:30:57.570073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-330b5db0-71f9-4c8c-a30b-e876867f53ea tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:57.571330 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-330b5db0-71f9-4c8c-a30b-e876867f53ea tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:57.579265 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-330b5db0-71f9-4c8c-a30b-e876867f53ea tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:57.579704 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-330b5db0-71f9-4c8c-a30b-e876867f53ea tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:57.580495 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-330b5db0-71f9-4c8c-a30b-e876867f53ea tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:57.580924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-330b5db0-71f9-4c8c-a30b-e876867f53ea tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:57.616841 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3fdd4723-922b-4470-92f6-f7549cc48482 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:57.620797 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3fdd4723-922b-4470-92f6-f7549cc48482 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:57.625793 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:30:57.630204 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fdd4723-922b-4470-92f6-f7549cc48482 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:57.630686 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fdd4723-922b-4470-92f6-f7549cc48482 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:57.631460 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fdd4723-922b-4470-92f6-f7549cc48482 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:57.631892 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3fdd4723-922b-4470-92f6-f7549cc48482 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:57.655931 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-330b5db0-71f9-4c8c-a30b-e876867f53ea tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:57.664542 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-330b5db0-71f9-4c8c-a30b-e876867f53ea tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1264 microversion: 2.1 time: 0.098306 May 26 20:30:57.665615 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 402/794] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:57 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1264 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:57.890074 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3fdd4723-922b-4470-92f6-f7549cc48482 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "POST /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/action" status: 202 len: 0 microversion: 2.20 time: 0.277292 May 26 20:30:57.893718 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 393/795] 10.222.0.44 () {62 vars in 1318 bytes} [Thu May 26 20:30:57 2022] POST /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 20:30:57.899523 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-061e20f9-8b11-493e-a5f7-76a7b05e9676 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:57.900139 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-061e20f9-8b11-493e-a5f7-76a7b05e9676 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:57.923930 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-061e20f9-8b11-493e-a5f7-76a7b05e9676 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:57.924470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-061e20f9-8b11-493e-a5f7-76a7b05e9676 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:57.925177 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-061e20f9-8b11-493e-a5f7-76a7b05e9676 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:57.925635 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-061e20f9-8b11-493e-a5f7-76a7b05e9676 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:58.045231 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9a23c114-83c8-4ea2-b6d3-6db5ec25d57f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:58.047674 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9a23c114-83c8-4ea2-b6d3-6db5ec25d57f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] [instance: 6f6f1ba5-371c-4465-8534-2eb1ef60acdb] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:58.054717 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a23c114-83c8-4ea2-b6d3-6db5ec25d57f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:58.055553 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a23c114-83c8-4ea2-b6d3-6db5ec25d57f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:58.056395 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a23c114-83c8-4ea2-b6d3-6db5ec25d57f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:58.057086 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a23c114-83c8-4ea2-b6d3-6db5ec25d57f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:58.075386 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-9a23c114-83c8-4ea2-b6d3-6db5ec25d57f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] HTTP exception thrown: Instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb could not be found. May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9a23c114-83c8-4ea2-b6d3-6db5ec25d57f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Request method failure captured: May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb HTTP/1.1 May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-LDmtovUkXnwMIQYE-SW9i2DZZX8Vqr7zabuA8-WGIOaKOWn8Sk16gk0KWfxM1uuESWXPp1OjIcgyD-4kgKpO5KfHrzghKJqnLfm8TrRzSiRxIu_YSQukQVn9xq7NtoqpcyRGdvlsHrG7alTr6SNoT6Obk5OM_AVgA2gxBBhnT4p1Y May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 437e2c484c1d4accb95b3787fd921363 May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-TestMinimumBasicScenario-1460194478 May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:30:58.078586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:30:58.080289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/437e2c484c1d4accb95b3787fd921363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/437e2c484c1d4accb95b3787fd921363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_437e2c484c1d4accb95b3787fd921363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/437e2c484c1d4accb95b3787fd921363"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:30:58.080289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-TestMinimumBasicScenario-1460194478 May 26 20:30:58.080289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 437e2c484c1d4accb95b3787fd921363 May 26 20:30:58.080289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1460194478 May 26 20:30:58.080289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-TestMinimumBasicScenario-1460194478-project May 26 20:30:58.080289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:30:58.080289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:30:58.080289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 0218a775ec8d415f924b34bcd40f87e6 May 26 20:30:58.080289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-TestMinimumBasicScenario-1460194478-project May 26 20:30:58.080289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:30:58.080289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb could not be found. May 26 20:30:58.080289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '6f6f1ba5-371c-4465-8534-2eb1ef60acdb'} May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb could not be found. May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:30:58.081279 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb could not be found. May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb could not be found. May 26 20:30:58.083503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:30:58.087135 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9a23c114-83c8-4ea2-b6d3-6db5ec25d57f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Returning 404 to user: Instance 6f6f1ba5-371c-4465-8534-2eb1ef60acdb could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:30:58.088282 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9a23c114-83c8-4ea2-b6d3-6db5ec25d57f tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb" status: 404 len: 111 microversion: 2.1 time: 0.047390 May 26 20:30:58.089046 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 394/796] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:58 2022] GET /compute/v2.1/servers/6f6f1ba5-371c-4465-8534-2eb1ef60acdb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 20:30:58.104749 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2a2d31ea-a0fb-4706-b2c6-3c4bf672d625 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] Calling method '.version_select at 0x7f2da454b9d0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:58.160111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-061e20f9-8b11-493e-a5f7-76a7b05e9676 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:58.170068 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-061e20f9-8b11-493e-a5f7-76a7b05e9676 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:58.172938 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-061e20f9-8b11-493e-a5f7-76a7b05e9676 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:58.174368 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-061e20f9-8b11-493e-a5f7-76a7b05e9676 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1749 microversion: 2.20 time: 0.279245 May 26 20:30:58.175647 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 403/797] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:57 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1749 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:58.232899 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2a2d31ea-a0fb-4706-b2c6-3c4bf672d625 tempest-TestMinimumBasicScenario-1460194478 tempest-TestMinimumBasicScenario-1460194478-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-446495996" status: 202 len: 0 microversion: 2.1 time: 0.139124 May 26 20:30:58.237083 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 395/798] 10.222.0.44 () {58 vars in 1268 bytes} [Thu May 26 20:30:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-446495996 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 20:30:58.682461 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1379d0a3-6d2e-471a-ba9f-84f2952dbd43 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:58.683195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-1379d0a3-6d2e-471a-ba9f-84f2952dbd43 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:58.691852 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1379d0a3-6d2e-471a-ba9f-84f2952dbd43 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:58.692305 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1379d0a3-6d2e-471a-ba9f-84f2952dbd43 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:58.693072 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1379d0a3-6d2e-471a-ba9f-84f2952dbd43 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:58.693501 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1379d0a3-6d2e-471a-ba9f-84f2952dbd43 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:58.878188 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1379d0a3-6d2e-471a-ba9f-84f2952dbd43 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:58.881651 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:30:58.886426 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1379d0a3-6d2e-471a-ba9f-84f2952dbd43 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1312 microversion: 2.1 time: 0.208275 May 26 20:30:58.886998 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 404/799] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:58 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1312 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:30:59.194176 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5a8173a2-e50d-46d8-8b68-4ada51f2d1c4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:59.194806 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5a8173a2-e50d-46d8-8b68-4ada51f2d1c4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:59.202908 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a8173a2-e50d-46d8-8b68-4ada51f2d1c4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:59.203318 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a8173a2-e50d-46d8-8b68-4ada51f2d1c4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:59.204202 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a8173a2-e50d-46d8-8b68-4ada51f2d1c4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:59.204639 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5a8173a2-e50d-46d8-8b68-4ada51f2d1c4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:59.415610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5a8173a2-e50d-46d8-8b68-4ada51f2d1c4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:59.425099 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5a8173a2-e50d-46d8-8b68-4ada51f2d1c4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:59.426658 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5a8173a2-e50d-46d8-8b68-4ada51f2d1c4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:30:59.428203 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5a8173a2-e50d-46d8-8b68-4ada51f2d1c4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1749 microversion: 2.20 time: 0.237661 May 26 20:30:59.428684 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 396/800] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:30:59 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1749 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:30:59.891397 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-2829399c-0143-407e-a5b3-a9d11c68dfb3 req-3020bc03-6aac-43a4-a23e-c192b8ebb928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30012bc-d8f9-409f-88b9-c20852b74ff0", "tag": "2ee80341-8ac7-4939-aeed-1b423cf16738"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:30:59.918907 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-df2d7449-7907-41a7-a781-6743bfeaddfe tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:30:59.919689 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-df2d7449-7907-41a7-a781-6743bfeaddfe tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:30:59.920378 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-2829399c-0143-407e-a5b3-a9d11c68dfb3 req-3020bc03-6aac-43a4-a23e-c192b8ebb928 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:59.921086 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-2829399c-0143-407e-a5b3-a9d11c68dfb3 req-3020bc03-6aac-43a4-a23e-c192b8ebb928 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:59.931415 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df2d7449-7907-41a7-a781-6743bfeaddfe tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:59.932121 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df2d7449-7907-41a7-a781-6743bfeaddfe tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:59.935696 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df2d7449-7907-41a7-a781-6743bfeaddfe tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:30:59.935696 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df2d7449-7907-41a7-a781-6743bfeaddfe tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:30:59.935939 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-2829399c-0143-407e-a5b3-a9d11c68dfb3 req-3020bc03-6aac-43a4-a23e-c192b8ebb928 service nova] Creating event network-changed:2ee80341-8ac7-4939-aeed-1b423cf16738 for instance b30012bc-d8f9-409f-88b9-c20852b74ff0 on hv-cinder-84213 May 26 20:30:59.944574 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-2829399c-0143-407e-a5b3-a9d11c68dfb3 req-3020bc03-6aac-43a4-a23e-c192b8ebb928 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061250 May 26 20:30:59.946404 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 405/801] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:31:00.218554 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-df2d7449-7907-41a7-a781-6743bfeaddfe tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:00.226788 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-df2d7449-7907-41a7-a781-6743bfeaddfe tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1312 microversion: 2.1 time: 0.326019 May 26 20:31:00.236993 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 397/802] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:30:59 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1312 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:31:00.447345 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-df09b710-ac19-4392-ba9d-1cf4dafa39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:00.447988 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-df09b710-ac19-4392-ba9d-1cf4dafa39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:00.454887 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-df09b710-ac19-4392-ba9d-1cf4dafa39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:00.455341 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-df09b710-ac19-4392-ba9d-1cf4dafa39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:00.456113 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-df09b710-ac19-4392-ba9d-1cf4dafa39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:00.456552 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-df09b710-ac19-4392-ba9d-1cf4dafa39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:00.885792 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-df09b710-ac19-4392-ba9d-1cf4dafa39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:00.899803 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-df09b710-ac19-4392-ba9d-1cf4dafa39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:00.901509 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-df09b710-ac19-4392-ba9d-1cf4dafa39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:00.903325 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-df09b710-ac19-4392-ba9d-1cf4dafa39b8 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1751 microversion: 2.20 time: 0.460756 May 26 20:31:00.903895 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 406/803] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:00 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1751 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:01.245369 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-66d047cd-19ad-4e91-b32f-7f32ad6d6857 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:01.246588 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-66d047cd-19ad-4e91-b32f-7f32ad6d6857 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:01.253440 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66d047cd-19ad-4e91-b32f-7f32ad6d6857 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:01.253889 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66d047cd-19ad-4e91-b32f-7f32ad6d6857 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:01.255149 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66d047cd-19ad-4e91-b32f-7f32ad6d6857 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:01.255943 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-66d047cd-19ad-4e91-b32f-7f32ad6d6857 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:01.414669 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-66d047cd-19ad-4e91-b32f-7f32ad6d6857 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:01.432423 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-66d047cd-19ad-4e91-b32f-7f32ad6d6857 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1312 microversion: 2.1 time: 0.191266 May 26 20:31:01.433299 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 398/804] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:01 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:01.927675 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7ed6c322-5c7e-4290-8e58-9a551d0295da tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:01.928286 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7ed6c322-5c7e-4290-8e58-9a551d0295da tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:01.936073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7ed6c322-5c7e-4290-8e58-9a551d0295da tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:01.937518 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7ed6c322-5c7e-4290-8e58-9a551d0295da tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:01.938881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7ed6c322-5c7e-4290-8e58-9a551d0295da tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:01.939644 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7ed6c322-5c7e-4290-8e58-9a551d0295da tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:02.101272 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7ed6c322-5c7e-4290-8e58-9a551d0295da tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:02.115528 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7ed6c322-5c7e-4290-8e58-9a551d0295da tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:02.117568 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7ed6c322-5c7e-4290-8e58-9a551d0295da tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:02.119454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7ed6c322-5c7e-4290-8e58-9a551d0295da tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.199220 May 26 20:31:02.120019 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 407/805] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:01 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:02.450349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7c218c0a-1779-413e-acb8-388e5d4b5b19 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:02.451114 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7c218c0a-1779-413e-acb8-388e5d4b5b19 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:02.458665 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7c218c0a-1779-413e-acb8-388e5d4b5b19 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:02.459111 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7c218c0a-1779-413e-acb8-388e5d4b5b19 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:02.459888 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7c218c0a-1779-413e-acb8-388e5d4b5b19 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:02.460322 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7c218c0a-1779-413e-acb8-388e5d4b5b19 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:02.852410 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7c218c0a-1779-413e-acb8-388e5d4b5b19 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:02.860140 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7c218c0a-1779-413e-acb8-388e5d4b5b19 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1312 microversion: 2.1 time: 0.413739 May 26 20:31:02.860809 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 399/806] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:02 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:03.138616 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-29628102-a8d7-4f11-833e-d3b94dcc353d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:03.145838 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-29628102-a8d7-4f11-833e-d3b94dcc353d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:03.146380 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-29628102-a8d7-4f11-833e-d3b94dcc353d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:03.146847 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-29628102-a8d7-4f11-833e-d3b94dcc353d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:03.147622 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-29628102-a8d7-4f11-833e-d3b94dcc353d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:03.148093 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-29628102-a8d7-4f11-833e-d3b94dcc353d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:03.302702 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-29628102-a8d7-4f11-833e-d3b94dcc353d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:03.313003 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-29628102-a8d7-4f11-833e-d3b94dcc353d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:03.315467 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-29628102-a8d7-4f11-833e-d3b94dcc353d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:03.317550 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-29628102-a8d7-4f11-833e-d3b94dcc353d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.182865 May 26 20:31:03.318652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 408/807] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:03 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:03.881272 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a01d5926-cd59-4828-830d-1b0c3d797ff7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:03.883344 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a01d5926-cd59-4828-830d-1b0c3d797ff7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:03.900829 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a01d5926-cd59-4828-830d-1b0c3d797ff7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:03.902025 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a01d5926-cd59-4828-830d-1b0c3d797ff7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:03.903235 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a01d5926-cd59-4828-830d-1b0c3d797ff7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:03.904555 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a01d5926-cd59-4828-830d-1b0c3d797ff7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:04.106597 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a01d5926-cd59-4828-830d-1b0c3d797ff7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:04.118780 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a01d5926-cd59-4828-830d-1b0c3d797ff7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1312 microversion: 2.1 time: 0.245193 May 26 20:31:04.128184 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 400/808] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:03 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:04.339326 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-99184232-afaf-40d8-b520-992943f3f3d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:04.340187 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-99184232-afaf-40d8-b520-992943f3f3d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:04.360737 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-99184232-afaf-40d8-b520-992943f3f3d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:04.363721 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-99184232-afaf-40d8-b520-992943f3f3d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:04.368756 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-99184232-afaf-40d8-b520-992943f3f3d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:04.370562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-99184232-afaf-40d8-b520-992943f3f3d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:04.773215 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-99184232-afaf-40d8-b520-992943f3f3d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:04.783506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-99184232-afaf-40d8-b520-992943f3f3d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:04.791765 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-99184232-afaf-40d8-b520-992943f3f3d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:04.793170 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-99184232-afaf-40d8-b520-992943f3f3d0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.460989 May 26 20:31:04.808153 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 409/809] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:04 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:05.136124 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6604f571-0a18-406b-9d3b-a4340b73c900 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:05.137435 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6604f571-0a18-406b-9d3b-a4340b73c900 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:05.150672 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:05.154925 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6604f571-0a18-406b-9d3b-a4340b73c900 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:05.156452 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6604f571-0a18-406b-9d3b-a4340b73c900 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:05.159292 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6604f571-0a18-406b-9d3b-a4340b73c900 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:05.159919 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6604f571-0a18-406b-9d3b-a4340b73c900 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:05.205550 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:05.386714 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6604f571-0a18-406b-9d3b-a4340b73c900 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:05.399954 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6604f571-0a18-406b-9d3b-a4340b73c900 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1312 microversion: 2.1 time: 0.266610 May 26 20:31:05.400549 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 401/810] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:05 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:05.818125 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-79f3fa1b-0b75-4619-94d5-4e3db3705867 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:05.818853 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-79f3fa1b-0b75-4619-94d5-4e3db3705867 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:05.837928 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-79f3fa1b-0b75-4619-94d5-4e3db3705867 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:05.838979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-79f3fa1b-0b75-4619-94d5-4e3db3705867 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:05.840282 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-79f3fa1b-0b75-4619-94d5-4e3db3705867 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:05.840958 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-79f3fa1b-0b75-4619-94d5-4e3db3705867 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:06.064913 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-543ef37e-7a10-45af-bd65-98aa03a0740e req-812631a9-dd9e-4e76-8358-e04b6e1b474c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30012bc-d8f9-409f-88b9-c20852b74ff0", "name": "network-vif-plugged", "status": "completed", "tag": "2ee80341-8ac7-4939-aeed-1b423cf16738"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:31:06.084117 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-543ef37e-7a10-45af-bd65-98aa03a0740e req-812631a9-dd9e-4e76-8358-e04b6e1b474c service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:06.084583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-543ef37e-7a10-45af-bd65-98aa03a0740e req-812631a9-dd9e-4e76-8358-e04b6e1b474c service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:06.098722 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-543ef37e-7a10-45af-bd65-98aa03a0740e req-812631a9-dd9e-4e76-8358-e04b6e1b474c service nova] Creating event network-vif-plugged:2ee80341-8ac7-4939-aeed-1b423cf16738 for instance b30012bc-d8f9-409f-88b9-c20852b74ff0 on hv-cinder-84213 May 26 20:31:06.105328 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-543ef37e-7a10-45af-bd65-98aa03a0740e req-812631a9-dd9e-4e76-8358-e04b6e1b474c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044600 May 26 20:31:06.106728 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 402/811] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:31:06.296585 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-79f3fa1b-0b75-4619-94d5-4e3db3705867 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:06.313510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-79f3fa1b-0b75-4619-94d5-4e3db3705867 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:06.315543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-79f3fa1b-0b75-4619-94d5-4e3db3705867 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:06.317214 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-79f3fa1b-0b75-4619-94d5-4e3db3705867 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.503489 May 26 20:31:06.317991 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 410/812] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:05 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:06.423117 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-80b77448-b940-4f1a-bfb2-6e47802e06ab tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:06.424547 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-80b77448-b940-4f1a-bfb2-6e47802e06ab tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:06.463362 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80b77448-b940-4f1a-bfb2-6e47802e06ab tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:06.464331 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80b77448-b940-4f1a-bfb2-6e47802e06ab tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:06.465316 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80b77448-b940-4f1a-bfb2-6e47802e06ab tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:06.465961 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80b77448-b940-4f1a-bfb2-6e47802e06ab tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:06.760635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-80b77448-b940-4f1a-bfb2-6e47802e06ab tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:06.770042 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-80b77448-b940-4f1a-bfb2-6e47802e06ab tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1312 microversion: 2.1 time: 0.354145 May 26 20:31:06.770668 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 403/813] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:06 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1312 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:07.336688 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8737ff3e-8c38-49c8-9cdf-5f2d339ef0f5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:07.338045 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8737ff3e-8c38-49c8-9cdf-5f2d339ef0f5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:07.341646 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=4 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:07.346787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8737ff3e-8c38-49c8-9cdf-5f2d339ef0f5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:07.347484 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8737ff3e-8c38-49c8-9cdf-5f2d339ef0f5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:07.348743 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8737ff3e-8c38-49c8-9cdf-5f2d339ef0f5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:07.357639 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8737ff3e-8c38-49c8-9cdf-5f2d339ef0f5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:07.650604 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8737ff3e-8c38-49c8-9cdf-5f2d339ef0f5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:07.661355 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8737ff3e-8c38-49c8-9cdf-5f2d339ef0f5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:07.663361 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8737ff3e-8c38-49c8-9cdf-5f2d339ef0f5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:07.664693 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8737ff3e-8c38-49c8-9cdf-5f2d339ef0f5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.333152 May 26 20:31:07.665291 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 411/814] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:07 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:07.790083 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8fdfbbf3-f819-478c-a0d3-27666ce72ed6 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:07.791486 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8fdfbbf3-f819-478c-a0d3-27666ce72ed6 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:07.802095 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8fdfbbf3-f819-478c-a0d3-27666ce72ed6 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:07.802854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8fdfbbf3-f819-478c-a0d3-27666ce72ed6 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:07.807308 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8fdfbbf3-f819-478c-a0d3-27666ce72ed6 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:07.807308 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8fdfbbf3-f819-478c-a0d3-27666ce72ed6 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:08.074001 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-8fdfbbf3-f819-478c-a0d3-27666ce72ed6 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:08.082665 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8fdfbbf3-f819-478c-a0d3-27666ce72ed6 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1312 microversion: 2.1 time: 0.299582 May 26 20:31:08.094987 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 404/815] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:07 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1312 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:08.683284 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-663c8606-03e4-4bfc-ac9c-23ed16a7160c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:08.683944 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-663c8606-03e4-4bfc-ac9c-23ed16a7160c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:08.691937 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-663c8606-03e4-4bfc-ac9c-23ed16a7160c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:08.692416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-663c8606-03e4-4bfc-ac9c-23ed16a7160c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:08.693210 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-663c8606-03e4-4bfc-ac9c-23ed16a7160c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:08.702670 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-663c8606-03e4-4bfc-ac9c-23ed16a7160c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:08.996131 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-663c8606-03e4-4bfc-ac9c-23ed16a7160c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:09.019388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-663c8606-03e4-4bfc-ac9c-23ed16a7160c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:09.021082 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-663c8606-03e4-4bfc-ac9c-23ed16a7160c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:09.022716 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-663c8606-03e4-4bfc-ac9c-23ed16a7160c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.343301 May 26 20:31:09.023922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 412/816] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:08 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:09.102694 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9ff74478-4e26-4871-a4d1-155884d721d7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:09.108340 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9ff74478-4e26-4871-a4d1-155884d721d7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:09.115535 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ff74478-4e26-4871-a4d1-155884d721d7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:09.116180 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ff74478-4e26-4871-a4d1-155884d721d7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:09.117162 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ff74478-4e26-4871-a4d1-155884d721d7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:09.117885 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9ff74478-4e26-4871-a4d1-155884d721d7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:09.407685 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9ff74478-4e26-4871-a4d1-155884d721d7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:09.407685 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9ff74478-4e26-4871-a4d1-155884d721d7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1312 microversion: 2.1 time: 0.288573 May 26 20:31:09.407685 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 405/817] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:09 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1312 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:10.057167 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-24bc57cf-e4e5-4912-a465-16fb126ef66f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:10.058554 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-24bc57cf-e4e5-4912-a465-16fb126ef66f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:10.071100 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24bc57cf-e4e5-4912-a465-16fb126ef66f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:10.072710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24bc57cf-e4e5-4912-a465-16fb126ef66f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:10.073527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24bc57cf-e4e5-4912-a465-16fb126ef66f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:10.073965 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-24bc57cf-e4e5-4912-a465-16fb126ef66f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:10.421094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eea5a0f5-1d5a-49b4-971a-1ac3cf7c0397 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:10.422035 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eea5a0f5-1d5a-49b4-971a-1ac3cf7c0397 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:10.424357 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-24bc57cf-e4e5-4912-a465-16fb126ef66f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:10.432625 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eea5a0f5-1d5a-49b4-971a-1ac3cf7c0397 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:10.433335 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eea5a0f5-1d5a-49b4-971a-1ac3cf7c0397 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:10.434317 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eea5a0f5-1d5a-49b4-971a-1ac3cf7c0397 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:10.434920 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eea5a0f5-1d5a-49b4-971a-1ac3cf7c0397 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:10.438338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-24bc57cf-e4e5-4912-a465-16fb126ef66f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:10.443390 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-24bc57cf-e4e5-4912-a465-16fb126ef66f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:10.444981 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-24bc57cf-e4e5-4912-a465-16fb126ef66f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.406038 May 26 20:31:10.456489 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 413/818] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:10 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:10.627127 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-eea5a0f5-1d5a-49b4-971a-1ac3cf7c0397 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:10.639750 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eea5a0f5-1d5a-49b4-971a-1ac3cf7c0397 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1312 microversion: 2.1 time: 0.223102 May 26 20:31:10.640632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 406/819] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:10 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:11.463963 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-148a7f6d-af8a-4dcc-9cf1-934bd3c1975d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:11.465664 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-148a7f6d-af8a-4dcc-9cf1-934bd3c1975d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:11.474412 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-148a7f6d-af8a-4dcc-9cf1-934bd3c1975d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:11.475572 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-148a7f6d-af8a-4dcc-9cf1-934bd3c1975d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:11.476519 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-148a7f6d-af8a-4dcc-9cf1-934bd3c1975d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:11.477034 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-148a7f6d-af8a-4dcc-9cf1-934bd3c1975d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:11.657607 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6ea228ef-6d68-4d61-a668-9b26cc5abae8 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:11.658224 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6ea228ef-6d68-4d61-a668-9b26cc5abae8 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:11.658905 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-148a7f6d-af8a-4dcc-9cf1-934bd3c1975d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:11.670026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ea228ef-6d68-4d61-a668-9b26cc5abae8 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:11.675362 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-148a7f6d-af8a-4dcc-9cf1-934bd3c1975d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:11.676867 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ea228ef-6d68-4d61-a668-9b26cc5abae8 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:11.677866 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ea228ef-6d68-4d61-a668-9b26cc5abae8 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:11.678357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6ea228ef-6d68-4d61-a668-9b26cc5abae8 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:11.680021 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-148a7f6d-af8a-4dcc-9cf1-934bd3c1975d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:11.682840 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-148a7f6d-af8a-4dcc-9cf1-934bd3c1975d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.221955 May 26 20:31:11.683834 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 414/820] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:11 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:11.954343 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6ea228ef-6d68-4d61-a668-9b26cc5abae8 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:11.964259 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6ea228ef-6d68-4d61-a668-9b26cc5abae8 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1496 microversion: 2.1 time: 0.310671 May 26 20:31:11.965679 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 407/821] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:11 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1496 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:12.704410 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b20284fa-9fb6-4e00-9f84-9e96ea72566f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:12.705319 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b20284fa-9fb6-4e00-9f84-9e96ea72566f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:12.711882 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b20284fa-9fb6-4e00-9f84-9e96ea72566f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:12.712669 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b20284fa-9fb6-4e00-9f84-9e96ea72566f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:12.713673 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b20284fa-9fb6-4e00-9f84-9e96ea72566f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:12.714604 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b20284fa-9fb6-4e00-9f84-9e96ea72566f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:12.993321 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b20284fa-9fb6-4e00-9f84-9e96ea72566f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:13.003173 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b20284fa-9fb6-4e00-9f84-9e96ea72566f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:13.005155 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b20284fa-9fb6-4e00-9f84-9e96ea72566f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:13.006675 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b20284fa-9fb6-4e00-9f84-9e96ea72566f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.306726 May 26 20:31:13.010375 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 415/822] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:12 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:13.355475 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1cef2262-4008-4b3a-88d8-9f329bb79d60 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:13.359048 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1cef2262-4008-4b3a-88d8-9f329bb79d60 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:13.363374 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1cef2262-4008-4b3a-88d8-9f329bb79d60 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:13.363827 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1cef2262-4008-4b3a-88d8-9f329bb79d60 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:13.364701 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1cef2262-4008-4b3a-88d8-9f329bb79d60 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:13.365146 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1cef2262-4008-4b3a-88d8-9f329bb79d60 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:13.390166 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1cef2262-4008-4b3a-88d8-9f329bb79d60 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:31:13.521154 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:13.722783 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1cef2262-4008-4b3a-88d8-9f329bb79d60 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 204 len: 0 microversion: 2.1 time: 0.370822 May 26 20:31:13.723377 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 408/823] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:31:13 2022] DELETE /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 20:31:13.739256 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5c189f51-c42d-4097-b2af-c81ab2a28d31 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:13.740089 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5c189f51-c42d-4097-b2af-c81ab2a28d31 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:13.747618 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5c189f51-c42d-4097-b2af-c81ab2a28d31 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:13.748216 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5c189f51-c42d-4097-b2af-c81ab2a28d31 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:13.750103 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5c189f51-c42d-4097-b2af-c81ab2a28d31 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:13.750631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5c189f51-c42d-4097-b2af-c81ab2a28d31 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:13.934973 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5c189f51-c42d-4097-b2af-c81ab2a28d31 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:13.946984 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5c189f51-c42d-4097-b2af-c81ab2a28d31 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1502 microversion: 2.1 time: 0.211949 May 26 20:31:13.947935 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 416/824] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:13 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:14.029399 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-98fd47cb-7615-4047-a6a4-8f2841c03a7a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:14.030057 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-98fd47cb-7615-4047-a6a4-8f2841c03a7a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:14.036546 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98fd47cb-7615-4047-a6a4-8f2841c03a7a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:14.041520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98fd47cb-7615-4047-a6a4-8f2841c03a7a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:14.041520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98fd47cb-7615-4047-a6a4-8f2841c03a7a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:14.041520 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98fd47cb-7615-4047-a6a4-8f2841c03a7a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:14.176697 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-98fd47cb-7615-4047-a6a4-8f2841c03a7a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:14.185045 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-98fd47cb-7615-4047-a6a4-8f2841c03a7a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:14.186560 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-98fd47cb-7615-4047-a6a4-8f2841c03a7a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:14.188543 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-98fd47cb-7615-4047-a6a4-8f2841c03a7a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.163514 May 26 20:31:14.189105 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 409/825] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:14 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:14.965174 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-dd77e85e-14cb-4064-9d25-1c8fc16a755a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:14.965972 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-dd77e85e-14cb-4064-9d25-1c8fc16a755a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:14.973931 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dd77e85e-14cb-4064-9d25-1c8fc16a755a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:14.974407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dd77e85e-14cb-4064-9d25-1c8fc16a755a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:14.975347 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dd77e85e-14cb-4064-9d25-1c8fc16a755a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:14.975987 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dd77e85e-14cb-4064-9d25-1c8fc16a755a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:15.109576 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-dd77e85e-14cb-4064-9d25-1c8fc16a755a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:15.117044 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-dd77e85e-14cb-4064-9d25-1c8fc16a755a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1502 microversion: 2.1 time: 0.155991 May 26 20:31:15.117786 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 417/826] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:14 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:31:15.207173 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2e971522-c39c-4d0d-b0b6-883109934586 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:15.210798 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2e971522-c39c-4d0d-b0b6-883109934586 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:15.215239 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e971522-c39c-4d0d-b0b6-883109934586 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:15.215688 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e971522-c39c-4d0d-b0b6-883109934586 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:15.216491 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e971522-c39c-4d0d-b0b6-883109934586 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:15.216958 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2e971522-c39c-4d0d-b0b6-883109934586 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:15.357089 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2e971522-c39c-4d0d-b0b6-883109934586 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:15.366053 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2e971522-c39c-4d0d-b0b6-883109934586 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:15.367603 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2e971522-c39c-4d0d-b0b6-883109934586 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:15.368766 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2e971522-c39c-4d0d-b0b6-883109934586 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.166125 May 26 20:31:15.369320 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 410/827] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:15 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:16.118845 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-65365711-f3f0-456c-bfc1-c0aea406ad54 req-df16abb0-42bd-470b-90e1-b852225869a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30012bc-d8f9-409f-88b9-c20852b74ff0", "name": "network-vif-deleted", "tag": "2ee80341-8ac7-4939-aeed-1b423cf16738"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:31:16.130962 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-65365711-f3f0-456c-bfc1-c0aea406ad54 req-df16abb0-42bd-470b-90e1-b852225869a0 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:16.131278 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-65365711-f3f0-456c-bfc1-c0aea406ad54 req-df16abb0-42bd-470b-90e1-b852225869a0 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:16.135381 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-98d45932-6b52-4449-94bb-bd6f3f7b8e75 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:16.136087 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-98d45932-6b52-4449-94bb-bd6f3f7b8e75 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:16.143604 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-65365711-f3f0-456c-bfc1-c0aea406ad54 req-df16abb0-42bd-470b-90e1-b852225869a0 service nova] Creating event network-vif-deleted:2ee80341-8ac7-4939-aeed-1b423cf16738 for instance b30012bc-d8f9-409f-88b9-c20852b74ff0 on hv-cinder-84213 May 26 20:31:16.146623 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98d45932-6b52-4449-94bb-bd6f3f7b8e75 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:16.148094 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98d45932-6b52-4449-94bb-bd6f3f7b8e75 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:16.149389 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-65365711-f3f0-456c-bfc1-c0aea406ad54 req-df16abb0-42bd-470b-90e1-b852225869a0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034625 May 26 20:31:16.150105 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98d45932-6b52-4449-94bb-bd6f3f7b8e75 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:16.150234 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 418/828] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:31:16.151584 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98d45932-6b52-4449-94bb-bd6f3f7b8e75 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:16.222395 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-98d45932-6b52-4449-94bb-bd6f3f7b8e75 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:16.230576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-98d45932-6b52-4449-94bb-bd6f3f7b8e75 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 200 len: 1460 microversion: 2.1 time: 0.100046 May 26 20:31:16.231384 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 411/829] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:16 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 1460 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:16.388097 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e0dad54c-bd88-42b2-9846-8bf00d93de4f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:16.388844 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e0dad54c-bd88-42b2-9846-8bf00d93de4f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:16.395578 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e0dad54c-bd88-42b2-9846-8bf00d93de4f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:16.399820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e0dad54c-bd88-42b2-9846-8bf00d93de4f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:16.399820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e0dad54c-bd88-42b2-9846-8bf00d93de4f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:16.399820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e0dad54c-bd88-42b2-9846-8bf00d93de4f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:16.543660 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e0dad54c-bd88-42b2-9846-8bf00d93de4f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:16.552484 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e0dad54c-bd88-42b2-9846-8bf00d93de4f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:16.554026 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e0dad54c-bd88-42b2-9846-8bf00d93de4f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:16.555217 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e0dad54c-bd88-42b2-9846-8bf00d93de4f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.171508 May 26 20:31:16.555813 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 419/830] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:16 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:17.247726 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-42e37106-f76c-4257-8139-68a2f1703b2e tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:17.248365 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-42e37106-f76c-4257-8139-68a2f1703b2e tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: b30012bc-d8f9-409f-88b9-c20852b74ff0] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:17.255096 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-42e37106-f76c-4257-8139-68a2f1703b2e tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:17.255551 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-42e37106-f76c-4257-8139-68a2f1703b2e tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:17.256322 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-42e37106-f76c-4257-8139-68a2f1703b2e tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:17.256765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-42e37106-f76c-4257-8139-68a2f1703b2e tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:17.272991 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-42e37106-f76c-4257-8139-68a2f1703b2e tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] HTTP exception thrown: Instance b30012bc-d8f9-409f-88b9-c20852b74ff0 could not be found. May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-42e37106-f76c-4257-8139-68a2f1703b2e tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Request method failure captured: May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 HTTP/1.1 May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-N8eWgmL-ZXsBEh3q8ebkPmpWz2l5vlxbAB_krPLajdRVCVGKGex-dH7cUWW8a3R2aGwhwziXLUiPALnrbHvgfpZ2JDWf9Yshj32cdaBUasCoBnRr3r2HoiRyj5ma6cxu2rjdJjgwiBgiV7DkhnCQ2u2ijJzVEb-893os109JO5Zcc May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: a13ea01e975047a7b1b04abfe3fd9e2b May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesActionsTest-2008695655 May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:31:17.274363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:31:17.275832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a13ea01e975047a7b1b04abfe3fd9e2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a13ea01e975047a7b1b04abfe3fd9e2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a13ea01e975047a7b1b04abfe3fd9e2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a13ea01e975047a7b1b04abfe3fd9e2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:31:17.275832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-VolumesActionsTest-2008695655 May 26 20:31:17.275832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: a13ea01e975047a7b1b04abfe3fd9e2b May 26 20:31:17.275832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesActionsTest-2008695655 May 26 20:31:17.275832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-VolumesActionsTest-2008695655-project May 26 20:31:17.275832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:31:17.275832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:31:17.275832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 74b6cb4022ad4492acde4d6ecf39773a May 26 20:31:17.275832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-VolumesActionsTest-2008695655-project May 26 20:31:17.275832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:31:17.275832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance b30012bc-d8f9-409f-88b9-c20852b74ff0 could not be found. May 26 20:31:17.275832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': 'b30012bc-d8f9-409f-88b9-c20852b74ff0'} May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30012bc-d8f9-409f-88b9-c20852b74ff0 could not be found. May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:31:17.276626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30012bc-d8f9-409f-88b9-c20852b74ff0 could not be found. May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30012bc-d8f9-409f-88b9-c20852b74ff0 could not be found. May 26 20:31:17.277965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:31:17.279232 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-42e37106-f76c-4257-8139-68a2f1703b2e tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Returning 404 to user: Instance b30012bc-d8f9-409f-88b9-c20852b74ff0 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:31:17.279232 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-42e37106-f76c-4257-8139-68a2f1703b2e tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0" status: 404 len: 111 microversion: 2.1 time: 0.031971 May 26 20:31:17.279232 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 412/831] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:17 2022] GET /compute/v2.1/servers/b30012bc-d8f9-409f-88b9-c20852b74ff0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:31:17.385668 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1186767710", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "networks": [{"uuid": "1dc13164-6bce-4218-9ce4-99825b65cbe5"}]}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:31:17.438326 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.network.neutron [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] validate_networks() for [('1dc13164-6bce-4218-9ce4-99825b65cbe5', None, None, None, None, None)] {{(pid=118306) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:31:17.578872 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fc70e767-5cd4-40aa-89e1-8ac27c48ac90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:17.590583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fc70e767-5cd4-40aa-89e1-8ac27c48ac90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:17.590583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc70e767-5cd4-40aa-89e1-8ac27c48ac90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:17.590583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc70e767-5cd4-40aa-89e1-8ac27c48ac90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:17.591962 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc70e767-5cd4-40aa-89e1-8ac27c48ac90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:17.592714 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc70e767-5cd4-40aa-89e1-8ac27c48ac90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:17.737113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-fc70e767-5cd4-40aa-89e1-8ac27c48ac90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:17.745788 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-fc70e767-5cd4-40aa-89e1-8ac27c48ac90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:17.747321 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-fc70e767-5cd4-40aa-89e1-8ac27c48ac90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:17.748498 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fc70e767-5cd4-40aa-89e1-8ac27c48ac90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.177395 May 26 20:31:17.749070 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 413/832] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:17 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:31:17.817833 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Flavor limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:31:17.818275 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Image limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:31:17.818757 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Flavor pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:31:17.819200 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Image pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:31:17.819609 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:31:17.829290 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:17.829732 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:17.830631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:17.831064 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:17.847954 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Getting quotas for project a13ea01e975047a7b1b04abfe3fd9e2b. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:31:17.851810 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Getting quotas for user 74b6cb4022ad4492acde4d6ecf39773a and project a13ea01e975047a7b1b04abfe3fd9e2b. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:31:17.862519 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Going to run 1 instances... {{(pid=118306) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:31:17.864728 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:31:18.536177 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2ba9874c-16b3-408b-82df-cb536b249a17 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.154294 May 26 20:31:18.536881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 420/833] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:31:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:31:18.546690 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8db6056a-cad8-4c87-ac9f-d7c8e88943c7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:18.547657 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8db6056a-cad8-4c87-ac9f-d7c8e88943c7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:18.600824 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-8db6056a-cad8-4c87-ac9f-d7c8e88943c7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:18.609628 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8db6056a-cad8-4c87-ac9f-d7c8e88943c7 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1214 microversion: 2.1 time: 0.064896 May 26 20:31:18.609628 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 414/834] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:18 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:31:18.772022 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cff22c1f-871a-4608-8fec-5e818e1606df tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:18.772736 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-cff22c1f-871a-4608-8fec-5e818e1606df tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:18.779746 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cff22c1f-871a-4608-8fec-5e818e1606df tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:18.780270 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cff22c1f-871a-4608-8fec-5e818e1606df tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:18.781118 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cff22c1f-871a-4608-8fec-5e818e1606df tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:18.781645 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cff22c1f-871a-4608-8fec-5e818e1606df tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:18.929673 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cff22c1f-871a-4608-8fec-5e818e1606df tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:18.966088 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cff22c1f-871a-4608-8fec-5e818e1606df tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:18.968441 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cff22c1f-871a-4608-8fec-5e818e1606df tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:18.972526 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-cff22c1f-871a-4608-8fec-5e818e1606df tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.202408 May 26 20:31:18.974507 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 421/835] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:18 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:19.632870 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ac22153f-172f-4f8f-88f7-1bfbab1f9863 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:19.633551 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ac22153f-172f-4f8f-88f7-1bfbab1f9863 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:19.640605 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ac22153f-172f-4f8f-88f7-1bfbab1f9863 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:19.641060 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ac22153f-172f-4f8f-88f7-1bfbab1f9863 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:19.642592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ac22153f-172f-4f8f-88f7-1bfbab1f9863 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:19.643036 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ac22153f-172f-4f8f-88f7-1bfbab1f9863 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:19.722656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ac22153f-172f-4f8f-88f7-1bfbab1f9863 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:19.730440 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ac22153f-172f-4f8f-88f7-1bfbab1f9863 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1218 microversion: 2.1 time: 0.101302 May 26 20:31:19.731102 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 415/836] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:19 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:19.992647 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a3ad2171-8970-4f2a-8e12-74b986e952eb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:19.993401 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a3ad2171-8970-4f2a-8e12-74b986e952eb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:20.001426 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a3ad2171-8970-4f2a-8e12-74b986e952eb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:20.001967 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a3ad2171-8970-4f2a-8e12-74b986e952eb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:20.002960 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a3ad2171-8970-4f2a-8e12-74b986e952eb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:20.003579 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a3ad2171-8970-4f2a-8e12-74b986e952eb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:20.145858 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a3ad2171-8970-4f2a-8e12-74b986e952eb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:20.154394 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a3ad2171-8970-4f2a-8e12-74b986e952eb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:20.155895 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a3ad2171-8970-4f2a-8e12-74b986e952eb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:20.157852 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a3ad2171-8970-4f2a-8e12-74b986e952eb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.169067 May 26 20:31:20.158556 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 422/837] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:19 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:20.748413 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3c416f66-a337-403f-ac96-2c6350b8c3e2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:20.749034 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3c416f66-a337-403f-ac96-2c6350b8c3e2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:20.756512 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c416f66-a337-403f-ac96-2c6350b8c3e2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:20.756958 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c416f66-a337-403f-ac96-2c6350b8c3e2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:20.757730 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c416f66-a337-403f-ac96-2c6350b8c3e2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:20.758171 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3c416f66-a337-403f-ac96-2c6350b8c3e2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:20.821269 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-3c416f66-a337-403f-ac96-2c6350b8c3e2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:20.828770 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3c416f66-a337-403f-ac96-2c6350b8c3e2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1274 microversion: 2.1 time: 0.084124 May 26 20:31:20.829950 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 416/838] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:20 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:21.180402 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-51b30b31-2148-4618-a16f-840a3a66864f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:21.181266 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-51b30b31-2148-4618-a16f-840a3a66864f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:21.203155 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-51b30b31-2148-4618-a16f-840a3a66864f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:21.203972 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-51b30b31-2148-4618-a16f-840a3a66864f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:21.205125 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-51b30b31-2148-4618-a16f-840a3a66864f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:21.205771 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-51b30b31-2148-4618-a16f-840a3a66864f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:21.242937 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=100 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:21.432911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-51b30b31-2148-4618-a16f-840a3a66864f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:21.442896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-51b30b31-2148-4618-a16f-840a3a66864f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:21.444638 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-51b30b31-2148-4618-a16f-840a3a66864f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:21.445840 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-51b30b31-2148-4618-a16f-840a3a66864f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.271696 May 26 20:31:21.446422 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 423/839] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:21 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:21.849240 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b384017e-f9ef-4fb7-8164-256bb304b602 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:21.849926 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b384017e-f9ef-4fb7-8164-256bb304b602 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:21.856765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b384017e-f9ef-4fb7-8164-256bb304b602 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:21.857251 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b384017e-f9ef-4fb7-8164-256bb304b602 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:21.858043 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b384017e-f9ef-4fb7-8164-256bb304b602 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:21.858493 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b384017e-f9ef-4fb7-8164-256bb304b602 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:22.051671 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b384017e-f9ef-4fb7-8164-256bb304b602 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:22.061376 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b384017e-f9ef-4fb7-8164-256bb304b602 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1314 microversion: 2.1 time: 0.218728 May 26 20:31:22.071485 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 417/840] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:21 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:22.464356 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ac30da1a-4c4c-46c6-b785-67262f20a89b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:22.464966 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ac30da1a-4c4c-46c6-b785-67262f20a89b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:22.471922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ac30da1a-4c4c-46c6-b785-67262f20a89b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:22.472364 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ac30da1a-4c4c-46c6-b785-67262f20a89b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:22.477186 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ac30da1a-4c4c-46c6-b785-67262f20a89b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:22.477186 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ac30da1a-4c4c-46c6-b785-67262f20a89b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:22.624464 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ac30da1a-4c4c-46c6-b785-67262f20a89b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:22.634630 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ac30da1a-4c4c-46c6-b785-67262f20a89b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:22.636875 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ac30da1a-4c4c-46c6-b785-67262f20a89b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:22.638298 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ac30da1a-4c4c-46c6-b785-67262f20a89b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.178240 May 26 20:31:22.638882 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 424/841] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:22 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:22.824910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-345eef1d-fee2-435b-8e76-8673d9a058f3 req-02390152-1f84-42e0-803a-3119ec6e3a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0297b7e2-7caa-443a-a2d1-c82e77f47a45", "tag": "4771e4ca-5488-41a2-be38-342a4a9ad65d"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:31:22.833139 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-345eef1d-fee2-435b-8e76-8673d9a058f3 req-02390152-1f84-42e0-803a-3119ec6e3a78 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:22.833667 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-345eef1d-fee2-435b-8e76-8673d9a058f3 req-02390152-1f84-42e0-803a-3119ec6e3a78 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:22.845454 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-345eef1d-fee2-435b-8e76-8673d9a058f3 req-02390152-1f84-42e0-803a-3119ec6e3a78 service nova] Creating event network-changed:4771e4ca-5488-41a2-be38-342a4a9ad65d for instance 0297b7e2-7caa-443a-a2d1-c82e77f47a45 on hv-cinder-84213 May 26 20:31:22.850342 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-345eef1d-fee2-435b-8e76-8673d9a058f3 req-02390152-1f84-42e0-803a-3119ec6e3a78 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030362 May 26 20:31:22.853743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 418/842] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:31:23.083041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ad813090-e593-4fec-b689-fbddb6dbf838 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:23.083041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ad813090-e593-4fec-b689-fbddb6dbf838 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:23.089805 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ad813090-e593-4fec-b689-fbddb6dbf838 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:23.090272 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ad813090-e593-4fec-b689-fbddb6dbf838 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:23.091052 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ad813090-e593-4fec-b689-fbddb6dbf838 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:23.091488 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ad813090-e593-4fec-b689-fbddb6dbf838 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:23.245288 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ad813090-e593-4fec-b689-fbddb6dbf838 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:23.253864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ad813090-e593-4fec-b689-fbddb6dbf838 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1314 microversion: 2.1 time: 0.176955 May 26 20:31:23.254714 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 425/843] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:23 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:23.658929 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-14a7addd-ea87-4cb8-b034-13121516cb6f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:23.659575 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-14a7addd-ea87-4cb8-b034-13121516cb6f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:23.665802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-14a7addd-ea87-4cb8-b034-13121516cb6f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:23.666319 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-14a7addd-ea87-4cb8-b034-13121516cb6f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:23.667047 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-14a7addd-ea87-4cb8-b034-13121516cb6f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:23.667486 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-14a7addd-ea87-4cb8-b034-13121516cb6f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:23.802816 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-14a7addd-ea87-4cb8-b034-13121516cb6f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:23.811537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-14a7addd-ea87-4cb8-b034-13121516cb6f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:23.813773 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-14a7addd-ea87-4cb8-b034-13121516cb6f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:23.814298 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-14a7addd-ea87-4cb8-b034-13121516cb6f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.161399 May 26 20:31:23.815031 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 419/844] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:23 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:24.271316 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-452bd711-3b74-4039-afc0-f67cf7c7d345 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:24.272198 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-452bd711-3b74-4039-afc0-f67cf7c7d345 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:24.278804 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-452bd711-3b74-4039-afc0-f67cf7c7d345 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:24.279245 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-452bd711-3b74-4039-afc0-f67cf7c7d345 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:24.279991 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-452bd711-3b74-4039-afc0-f67cf7c7d345 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:24.280420 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-452bd711-3b74-4039-afc0-f67cf7c7d345 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:24.420608 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-452bd711-3b74-4039-afc0-f67cf7c7d345 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:24.429254 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-452bd711-3b74-4039-afc0-f67cf7c7d345 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1314 microversion: 2.1 time: 0.162430 May 26 20:31:24.437411 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 426/845] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:24 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:24.833096 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0741f953-0ce8-4a51-aa94-a4b4f9ac7165 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:24.833697 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0741f953-0ce8-4a51-aa94-a4b4f9ac7165 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:24.840446 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0741f953-0ce8-4a51-aa94-a4b4f9ac7165 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:24.840900 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0741f953-0ce8-4a51-aa94-a4b4f9ac7165 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:24.841678 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0741f953-0ce8-4a51-aa94-a4b4f9ac7165 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:24.842119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0741f953-0ce8-4a51-aa94-a4b4f9ac7165 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:24.972369 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-0741f953-0ce8-4a51-aa94-a4b4f9ac7165 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:24.980795 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-0741f953-0ce8-4a51-aa94-a4b4f9ac7165 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:24.982310 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-0741f953-0ce8-4a51-aa94-a4b4f9ac7165 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:24.983477 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0741f953-0ce8-4a51-aa94-a4b4f9ac7165 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.154509 May 26 20:31:24.984042 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 420/846] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:24 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:25.445991 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-fdfa6320-a1e3-404d-b682-7ea4921abab5 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:25.446763 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-fdfa6320-a1e3-404d-b682-7ea4921abab5 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:25.453339 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fdfa6320-a1e3-404d-b682-7ea4921abab5 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:25.457445 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fdfa6320-a1e3-404d-b682-7ea4921abab5 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:25.457445 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fdfa6320-a1e3-404d-b682-7ea4921abab5 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:25.457445 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fdfa6320-a1e3-404d-b682-7ea4921abab5 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:25.583553 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-fdfa6320-a1e3-404d-b682-7ea4921abab5 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:25.591220 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-fdfa6320-a1e3-404d-b682-7ea4921abab5 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1314 microversion: 2.1 time: 0.149094 May 26 20:31:25.591785 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 427/847] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:25 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:26.002218 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2df5975b-9d15-4d65-8a2d-0350e02b096a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:26.002873 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2df5975b-9d15-4d65-8a2d-0350e02b096a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:26.010332 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2df5975b-9d15-4d65-8a2d-0350e02b096a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:26.010792 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2df5975b-9d15-4d65-8a2d-0350e02b096a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:26.011585 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2df5975b-9d15-4d65-8a2d-0350e02b096a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:26.012017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2df5975b-9d15-4d65-8a2d-0350e02b096a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:26.059070 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-824b7017-f3cb-4d35-b336-2614bfcdff7c req-c07d8923-2a1d-45cf-a375-eba517c3c118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419dd0d9-334f-4481-aa27-8c24115614db", "name": "network-vif-plugged", "status": "completed", "tag": "9ff1ecd8-c0e6-4014-b5c2-850b82d549df"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:31:26.068537 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-824b7017-f3cb-4d35-b336-2614bfcdff7c req-c07d8923-2a1d-45cf-a375-eba517c3c118 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:26.069071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-824b7017-f3cb-4d35-b336-2614bfcdff7c req-c07d8923-2a1d-45cf-a375-eba517c3c118 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:26.083707 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-824b7017-f3cb-4d35-b336-2614bfcdff7c req-c07d8923-2a1d-45cf-a375-eba517c3c118 service nova] Creating event network-vif-plugged:9ff1ecd8-c0e6-4014-b5c2-850b82d549df for instance 419dd0d9-334f-4481-aa27-8c24115614db on hv-cinder-84213 May 26 20:31:26.089069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-824b7017-f3cb-4d35-b336-2614bfcdff7c req-c07d8923-2a1d-45cf-a375-eba517c3c118 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033653 May 26 20:31:26.089682 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 428/848] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:31:26.150661 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2df5975b-9d15-4d65-8a2d-0350e02b096a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:26.159213 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2df5975b-9d15-4d65-8a2d-0350e02b096a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:26.161397 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2df5975b-9d15-4d65-8a2d-0350e02b096a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:26.162635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2df5975b-9d15-4d65-8a2d-0350e02b096a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.164350 May 26 20:31:26.163202 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 421/849] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:25 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:26.608999 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-eef06f9d-7d56-4477-958a-9dfc52287b61 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:26.609699 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-eef06f9d-7d56-4477-958a-9dfc52287b61 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:26.612160 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:26.618416 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-eef06f9d-7d56-4477-958a-9dfc52287b61 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:26.618868 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-eef06f9d-7d56-4477-958a-9dfc52287b61 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:26.619637 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-eef06f9d-7d56-4477-958a-9dfc52287b61 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:26.620165 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-eef06f9d-7d56-4477-958a-9dfc52287b61 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:26.766749 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-eef06f9d-7d56-4477-958a-9dfc52287b61 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:26.774832 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-eef06f9d-7d56-4477-958a-9dfc52287b61 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1314 microversion: 2.1 time: 0.170039 May 26 20:31:26.781325 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 429/850] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:26 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:27.181161 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c930b3fa-a32c-4159-bbfa-d304535327e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:27.181779 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c930b3fa-a32c-4159-bbfa-d304535327e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:27.188361 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c930b3fa-a32c-4159-bbfa-d304535327e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:27.188815 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c930b3fa-a32c-4159-bbfa-d304535327e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:27.189592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c930b3fa-a32c-4159-bbfa-d304535327e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:27.190036 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c930b3fa-a32c-4159-bbfa-d304535327e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:27.625502 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c930b3fa-a32c-4159-bbfa-d304535327e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:27.635108 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c930b3fa-a32c-4159-bbfa-d304535327e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:27.636631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c930b3fa-a32c-4159-bbfa-d304535327e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:27.637873 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c930b3fa-a32c-4159-bbfa-d304535327e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.460622 May 26 20:31:27.638639 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 422/851] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:27 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:27.791230 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-93dba78c-1f68-4d34-a46c-634ed8afe04a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:27.791854 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-93dba78c-1f68-4d34-a46c-634ed8afe04a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:27.800350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-93dba78c-1f68-4d34-a46c-634ed8afe04a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:27.801031 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-93dba78c-1f68-4d34-a46c-634ed8afe04a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:27.801816 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-93dba78c-1f68-4d34-a46c-634ed8afe04a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:27.802424 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-93dba78c-1f68-4d34-a46c-634ed8afe04a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:27.839623 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:27.857750 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=6 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:27.946117 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-93dba78c-1f68-4d34-a46c-634ed8afe04a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:27.954474 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-93dba78c-1f68-4d34-a46c-634ed8afe04a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1314 microversion: 2.1 time: 0.166947 May 26 20:31:27.955300 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 430/852] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:27 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:28.108093 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-f87c51f1-ac47-43fb-920a-df2bd4172efe req-c3d4e780-c516-44ad-9d9d-212139fe27ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0297b7e2-7caa-443a-a2d1-c82e77f47a45", "name": "network-vif-plugged", "status": "completed", "tag": "4771e4ca-5488-41a2-be38-342a4a9ad65d"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:31:28.112306 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:28.120664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f87c51f1-ac47-43fb-920a-df2bd4172efe req-c3d4e780-c516-44ad-9d9d-212139fe27ce service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:28.121114 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-f87c51f1-ac47-43fb-920a-df2bd4172efe req-c3d4e780-c516-44ad-9d9d-212139fe27ce service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:28.135430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-f87c51f1-ac47-43fb-920a-df2bd4172efe req-c3d4e780-c516-44ad-9d9d-212139fe27ce service nova] Creating event network-vif-plugged:4771e4ca-5488-41a2-be38-342a4a9ad65d for instance 0297b7e2-7caa-443a-a2d1-c82e77f47a45 on hv-cinder-84213 May 26 20:31:28.146792 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-f87c51f1-ac47-43fb-920a-df2bd4172efe req-c3d4e780-c516-44ad-9d9d-212139fe27ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037673 May 26 20:31:28.146792 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 423/853] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:31:28.657067 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-12a91159-ca65-4409-b47e-3e5d30a256be tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:28.659634 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-12a91159-ca65-4409-b47e-3e5d30a256be tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:28.665569 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12a91159-ca65-4409-b47e-3e5d30a256be tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:28.666016 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12a91159-ca65-4409-b47e-3e5d30a256be tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:28.666801 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12a91159-ca65-4409-b47e-3e5d30a256be tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:28.667238 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12a91159-ca65-4409-b47e-3e5d30a256be tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:28.828390 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-12a91159-ca65-4409-b47e-3e5d30a256be tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:28.837560 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-12a91159-ca65-4409-b47e-3e5d30a256be tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:28.839821 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-12a91159-ca65-4409-b47e-3e5d30a256be tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:28.840533 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-12a91159-ca65-4409-b47e-3e5d30a256be tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1807 microversion: 2.20 time: 0.187813 May 26 20:31:28.841098 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 431/854] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:28 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:28.970327 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:28.977296 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fe599259-78dd-4599-95c1-97f278b79d56 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:28.978370 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fe599259-78dd-4599-95c1-97f278b79d56 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:28.985272 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe599259-78dd-4599-95c1-97f278b79d56 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:28.985730 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe599259-78dd-4599-95c1-97f278b79d56 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:28.986715 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe599259-78dd-4599-95c1-97f278b79d56 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:28.987154 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fe599259-78dd-4599-95c1-97f278b79d56 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:29.120436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-fe599259-78dd-4599-95c1-97f278b79d56 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:29.128291 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fe599259-78dd-4599-95c1-97f278b79d56 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1314 microversion: 2.1 time: 0.159265 May 26 20:31:29.129581 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 424/855] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:28 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:29.858979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7286b2c7-1778-4f34-b297-ffe37108e791 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:29.859582 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7286b2c7-1778-4f34-b297-ffe37108e791 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:29.866181 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7286b2c7-1778-4f34-b297-ffe37108e791 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:29.866649 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7286b2c7-1778-4f34-b297-ffe37108e791 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:29.867441 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7286b2c7-1778-4f34-b297-ffe37108e791 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:29.867838 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7286b2c7-1778-4f34-b297-ffe37108e791 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:30.002492 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7286b2c7-1778-4f34-b297-ffe37108e791 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:30.012337 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7286b2c7-1778-4f34-b297-ffe37108e791 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:30.013963 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7286b2c7-1778-4f34-b297-ffe37108e791 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:30.015167 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7286b2c7-1778-4f34-b297-ffe37108e791 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1794 microversion: 2.20 time: 0.160149 May 26 20:31:30.015727 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 432/856] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:31:29 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1794 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:31:30.146733 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-388cc73e-6d94-4462-a24f-19ad7fa52ed2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:30.147346 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-388cc73e-6d94-4462-a24f-19ad7fa52ed2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:30.154038 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-388cc73e-6d94-4462-a24f-19ad7fa52ed2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:30.154525 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-388cc73e-6d94-4462-a24f-19ad7fa52ed2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:30.155286 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-388cc73e-6d94-4462-a24f-19ad7fa52ed2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:30.155722 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-388cc73e-6d94-4462-a24f-19ad7fa52ed2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:30.288144 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-388cc73e-6d94-4462-a24f-19ad7fa52ed2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:30.295506 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-388cc73e-6d94-4462-a24f-19ad7fa52ed2 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1497 microversion: 2.1 time: 0.153697 May 26 20:31:30.296099 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 425/857] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:30 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:31.022916 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-92e9c9c0-0a88-4de6-8d45-d9b8c35299f1 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:31.023451 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-92e9c9c0-0a88-4de6-8d45-d9b8c35299f1 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:31.029924 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-92e9c9c0-0a88-4de6-8d45-d9b8c35299f1 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:31.030405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-92e9c9c0-0a88-4de6-8d45-d9b8c35299f1 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:31.031165 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-92e9c9c0-0a88-4de6-8d45-d9b8c35299f1 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:31.031596 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-92e9c9c0-0a88-4de6-8d45-d9b8c35299f1 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:31.072336 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-92e9c9c0-0a88-4de6-8d45-d9b8c35299f1 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Going to try to terminate instance {{(pid=118306) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:31:31.371599 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-92e9c9c0-0a88-4de6-8d45-d9b8c35299f1 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 204 len: 0 microversion: 2.1 time: 0.353069 May 26 20:31:31.372106 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 433/858] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:31:31 2022] DELETE /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:31:31.381163 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-30dd8e1a-d182-4b01-8401-6203613e070a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:31.381771 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-30dd8e1a-d182-4b01-8401-6203613e070a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:31.388100 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-30dd8e1a-d182-4b01-8401-6203613e070a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:31.388557 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-30dd8e1a-d182-4b01-8401-6203613e070a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:31.389328 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-30dd8e1a-d182-4b01-8401-6203613e070a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:31.389770 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-30dd8e1a-d182-4b01-8401-6203613e070a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:31.516769 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-30dd8e1a-d182-4b01-8401-6203613e070a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:31.524297 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-30dd8e1a-d182-4b01-8401-6203613e070a tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1503 microversion: 2.1 time: 0.147849 May 26 20:31:31.524916 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 426/859] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:31 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:32.063677 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b0d4cd70-f642-4cfb-a0d7-b25b169a6232 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:32.064268 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b0d4cd70-f642-4cfb-a0d7-b25b169a6232 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:32.071138 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b0d4cd70-f642-4cfb-a0d7-b25b169a6232 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:32.071589 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b0d4cd70-f642-4cfb-a0d7-b25b169a6232 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:32.072347 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b0d4cd70-f642-4cfb-a0d7-b25b169a6232 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:32.072783 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b0d4cd70-f642-4cfb-a0d7-b25b169a6232 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:32.100884 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b0d4cd70-f642-4cfb-a0d7-b25b169a6232 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Going to try to terminate instance {{(pid=118306) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:31:32.424491 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b0d4cd70-f642-4cfb-a0d7-b25b169a6232 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "DELETE /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 204 len: 0 microversion: 2.1 time: 0.364661 May 26 20:31:32.425110 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 434/860] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:31:32 2022] DELETE /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:31:32.433382 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-5bc8f19b-d2c2-47b7-ab0e-9c32b54d4014 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:32.434001 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-5bc8f19b-d2c2-47b7-ab0e-9c32b54d4014 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:32.440660 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5bc8f19b-d2c2-47b7-ab0e-9c32b54d4014 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:32.441148 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5bc8f19b-d2c2-47b7-ab0e-9c32b54d4014 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:32.441921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5bc8f19b-d2c2-47b7-ab0e-9c32b54d4014 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:32.442908 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-5bc8f19b-d2c2-47b7-ab0e-9c32b54d4014 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:32.541364 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b1183cc0-e019-47ae-a995-12920aebd4a3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:32.542057 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b1183cc0-e019-47ae-a995-12920aebd4a3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:32.548041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b1183cc0-e019-47ae-a995-12920aebd4a3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:32.552880 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b1183cc0-e019-47ae-a995-12920aebd4a3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:32.552880 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b1183cc0-e019-47ae-a995-12920aebd4a3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:32.552880 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b1183cc0-e019-47ae-a995-12920aebd4a3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:32.577700 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-5bc8f19b-d2c2-47b7-ab0e-9c32b54d4014 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:32.586532 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-5bc8f19b-d2c2-47b7-ab0e-9c32b54d4014 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1577 microversion: 2.1 time: 0.157041 May 26 20:31:32.593669 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 427/861] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:32 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:32.678502 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-b1183cc0-e019-47ae-a995-12920aebd4a3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:32.686057 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b1183cc0-e019-47ae-a995-12920aebd4a3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1503 microversion: 2.1 time: 0.148875 May 26 20:31:32.690551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 435/862] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:32 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:31:33.605185 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-63644488-0103-4161-be20-7c3c9dfa9aff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:33.605898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-63644488-0103-4161-be20-7c3c9dfa9aff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:33.612583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63644488-0103-4161-be20-7c3c9dfa9aff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:33.613038 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63644488-0103-4161-be20-7c3c9dfa9aff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:33.613820 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63644488-0103-4161-be20-7c3c9dfa9aff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:33.614927 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-63644488-0103-4161-be20-7c3c9dfa9aff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:33.619496 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:33.706112 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8bd55d2f-b8dd-497b-915e-bfa7874b50d3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:33.706755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8bd55d2f-b8dd-497b-915e-bfa7874b50d3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:33.714452 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8bd55d2f-b8dd-497b-915e-bfa7874b50d3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:33.714910 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8bd55d2f-b8dd-497b-915e-bfa7874b50d3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:33.715685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8bd55d2f-b8dd-497b-915e-bfa7874b50d3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:33.716122 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8bd55d2f-b8dd-497b-915e-bfa7874b50d3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:33.787379 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-63644488-0103-4161-be20-7c3c9dfa9aff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:33.795348 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-63644488-0103-4161-be20-7c3c9dfa9aff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1577 microversion: 2.1 time: 0.193986 May 26 20:31:33.796086 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 428/863] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:33 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:33.848919 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8bd55d2f-b8dd-497b-915e-bfa7874b50d3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:33.856539 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8bd55d2f-b8dd-497b-915e-bfa7874b50d3 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1503 microversion: 2.1 time: 0.154312 May 26 20:31:33.857047 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 436/864] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:33 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:34.649555 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-3fa29d63-93b0-4775-a18d-4597124cb779 req-85fd4aeb-df7b-4412-a19f-ae18ff93bd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0297b7e2-7caa-443a-a2d1-c82e77f47a45", "name": "network-vif-deleted", "tag": "4771e4ca-5488-41a2-be38-342a4a9ad65d"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:31:34.658384 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3fa29d63-93b0-4775-a18d-4597124cb779 req-85fd4aeb-df7b-4412-a19f-ae18ff93bd90 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:34.658905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-3fa29d63-93b0-4775-a18d-4597124cb779 req-85fd4aeb-df7b-4412-a19f-ae18ff93bd90 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:34.671082 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-3fa29d63-93b0-4775-a18d-4597124cb779 req-85fd4aeb-df7b-4412-a19f-ae18ff93bd90 service nova] Creating event network-vif-deleted:4771e4ca-5488-41a2-be38-342a4a9ad65d for instance 0297b7e2-7caa-443a-a2d1-c82e77f47a45 on hv-cinder-84213 May 26 20:31:34.676026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-3fa29d63-93b0-4775-a18d-4597124cb779 req-85fd4aeb-df7b-4412-a19f-ae18ff93bd90 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030501 May 26 20:31:34.677428 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 429/865] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:31:34.813324 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-75863436-96a4-4f15-9da0-da8545c546a4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:34.813990 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-75863436-96a4-4f15-9da0-da8545c546a4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:34.821260 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75863436-96a4-4f15-9da0-da8545c546a4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:34.821718 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75863436-96a4-4f15-9da0-da8545c546a4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:34.822522 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75863436-96a4-4f15-9da0-da8545c546a4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:34.823176 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-75863436-96a4-4f15-9da0-da8545c546a4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:34.842587 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:34.873829 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d2c0b93f-0886-4b0e-a581-293eca050973 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:34.874552 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d2c0b93f-0886-4b0e-a581-293eca050973 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:34.881052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2c0b93f-0886-4b0e-a581-293eca050973 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:34.881574 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2c0b93f-0886-4b0e-a581-293eca050973 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:34.882414 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2c0b93f-0886-4b0e-a581-293eca050973 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:34.882847 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d2c0b93f-0886-4b0e-a581-293eca050973 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:34.970852 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-75863436-96a4-4f15-9da0-da8545c546a4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:34.983455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-d2c0b93f-0886-4b0e-a581-293eca050973 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b6cb4022ad4492acde4d6ecf39773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13ea01e975047a7b1b04abfe3fd9e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:34.984654 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-75863436-96a4-4f15-9da0-da8545c546a4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1577 microversion: 2.1 time: 0.175433 May 26 20:31:34.985440 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 437/866] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:34 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:34.993174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d2c0b93f-0886-4b0e-a581-293eca050973 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 200 len: 1299 microversion: 2.1 time: 0.123897 May 26 20:31:34.994288 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 430/867] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:34 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:31:36.002909 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a95711f3-9ae6-45f5-b21a-e4f01fbf0b0c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:36.003560 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a95711f3-9ae6-45f5-b21a-e4f01fbf0b0c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:36.011900 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a95711f3-9ae6-45f5-b21a-e4f01fbf0b0c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:36.012208 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a95711f3-9ae6-45f5-b21a-e4f01fbf0b0c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:36.012978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a95711f3-9ae6-45f5-b21a-e4f01fbf0b0c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:36.013410 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a95711f3-9ae6-45f5-b21a-e4f01fbf0b0c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:36.018772 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e988d1c3-2a46-4756-8bbc-5a84f04fa806 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:36.019770 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e988d1c3-2a46-4756-8bbc-5a84f04fa806 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] [instance: 0297b7e2-7caa-443a-a2d1-c82e77f47a45] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:36.032655 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e988d1c3-2a46-4756-8bbc-5a84f04fa806 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:36.033220 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e988d1c3-2a46-4756-8bbc-5a84f04fa806 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:36.036165 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e988d1c3-2a46-4756-8bbc-5a84f04fa806 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:36.036165 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e988d1c3-2a46-4756-8bbc-5a84f04fa806 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:36.047400 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a95711f3-9ae6-45f5-b21a-e4f01fbf0b0c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:36.048014 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a95711f3-9ae6-45f5-b21a-e4f01fbf0b0c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:36.048471 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-a95711f3-9ae6-45f5-b21a-e4f01fbf0b0c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lazy-loading 'fault' on Instance uuid 39113a21-669c-497d-9364-469eec53967d {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:31:36.052387 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-e988d1c3-2a46-4756-8bbc-5a84f04fa806 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] HTTP exception thrown: Instance 0297b7e2-7caa-443a-a2d1-c82e77f47a45 could not be found. May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e988d1c3-2a46-4756-8bbc-5a84f04fa806 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Request method failure captured: May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 HTTP/1.1 May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-N8eWgmL-ZXsBEh3q8ebkPmpWz2l5vlxbAB_krPLajdRVCVGKGex-dH7cUWW8a3R2aGwhwziXLUiPALnrbHvgfpZ2JDWf9Yshj32cdaBUasCoBnRr3r2HoiRyj5ma6cxu2rjdJjgwiBgiV7DkhnCQ2u2ijJzVEb-893os109JO5Zcc May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: a13ea01e975047a7b1b04abfe3fd9e2b May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-VolumesActionsTest-2008695655 May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:31:36.054183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:31:36.056012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a13ea01e975047a7b1b04abfe3fd9e2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a13ea01e975047a7b1b04abfe3fd9e2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a13ea01e975047a7b1b04abfe3fd9e2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a13ea01e975047a7b1b04abfe3fd9e2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:31:36.056012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-VolumesActionsTest-2008695655 May 26 20:31:36.056012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: a13ea01e975047a7b1b04abfe3fd9e2b May 26 20:31:36.056012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-VolumesActionsTest-2008695655 May 26 20:31:36.056012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-VolumesActionsTest-2008695655-project May 26 20:31:36.056012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:31:36.056012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:31:36.056012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 74b6cb4022ad4492acde4d6ecf39773a May 26 20:31:36.056012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-VolumesActionsTest-2008695655-project May 26 20:31:36.056012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:31:36.056012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 0297b7e2-7caa-443a-a2d1-c82e77f47a45 could not be found. May 26 20:31:36.056012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '0297b7e2-7caa-443a-a2d1-c82e77f47a45'} May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0297b7e2-7caa-443a-a2d1-c82e77f47a45 could not be found. May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:31:36.057012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0297b7e2-7caa-443a-a2d1-c82e77f47a45 could not be found. May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0297b7e2-7caa-443a-a2d1-c82e77f47a45 could not be found. May 26 20:31:36.058576 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:31:36.060381 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e988d1c3-2a46-4756-8bbc-5a84f04fa806 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] Returning 404 to user: Instance 0297b7e2-7caa-443a-a2d1-c82e77f47a45 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:31:36.060951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e988d1c3-2a46-4756-8bbc-5a84f04fa806 tempest-VolumesActionsTest-2008695655 tempest-VolumesActionsTest-2008695655-project] 10.222.0.44 "GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45" status: 404 len: 111 microversion: 2.1 time: 0.047147 May 26 20:31:36.061718 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 431/868] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:36 2022] GET /compute/v2.1/servers/0297b7e2-7caa-443a-a2d1-c82e77f47a45 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:31:36.099214 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-a95711f3-9ae6-45f5-b21a-e4f01fbf0b0c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:36.108714 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a95711f3-9ae6-45f5-b21a-e4f01fbf0b0c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 200 len: 1230 microversion: 2.1 time: 0.110270 May 26 20:31:36.109508 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 438/869] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:35 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:36.691803 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-24ef728c-a5d2-4867-8768-85c96d22d75c req-a30adb92-9e5e-427e-9e01-bd51e3a01769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39113a21-669c-497d-9364-469eec53967d", "name": "network-vif-deleted", "tag": "b712f1a3-a312-49b0-b2f0-18cd232d399a"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:31:36.701171 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-24ef728c-a5d2-4867-8768-85c96d22d75c req-a30adb92-9e5e-427e-9e01-bd51e3a01769 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:36.701617 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-24ef728c-a5d2-4867-8768-85c96d22d75c req-a30adb92-9e5e-427e-9e01-bd51e3a01769 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:36.714647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-24ef728c-a5d2-4867-8768-85c96d22d75c req-a30adb92-9e5e-427e-9e01-bd51e3a01769 service nova] Creating event network-vif-deleted:b712f1a3-a312-49b0-b2f0-18cd232d399a for instance 39113a21-669c-497d-9364-469eec53967d on hv-cinder-84213 May 26 20:31:36.719794 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-24ef728c-a5d2-4867-8768-85c96d22d75c req-a30adb92-9e5e-427e-9e01-bd51e3a01769 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031598 May 26 20:31:36.720410 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 432/870] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:31:37.127248 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b35a11e7-6b92-4118-ab77-045c79164681 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:37.127863 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-b35a11e7-6b92-4118-ab77-045c79164681 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:37.136386 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b35a11e7-6b92-4118-ab77-045c79164681 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:37.136841 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b35a11e7-6b92-4118-ab77-045c79164681 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:37.137619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b35a11e7-6b92-4118-ab77-045c79164681 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:37.138077 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-b35a11e7-6b92-4118-ab77-045c79164681 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:37.154501 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-b35a11e7-6b92-4118-ab77-045c79164681 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] HTTP exception thrown: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b35a11e7-6b92-4118-ab77-045c79164681 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Request method failure captured: May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d HTTP/1.1 May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-Lw_qPeOb0AIk6o9WPUMrO2DsXPuhWMCZKOnVq_1TjSgjvp0Yfw1IYLf11TFCXcNvHO5sAF5zAPqLpGHdyyyx5KoZBjXZsznDl8hNi5ZA7Np9Ru-2vznMd0cN643jpbgosd2W5hqhHfaW7d2SV3TgvRhBbO3x9JlB6qAoYy1tTM5f4 May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: 772b1948bd9546669688fe60a8c9ba46 May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-TestVolumeBootPattern-204955540 May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:31:37.155029 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:31:37.156407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:31:37.156407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-TestVolumeBootPattern-204955540 May 26 20:31:37.156407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: 772b1948bd9546669688fe60a8c9ba46 May 26 20:31:37.156407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-TestVolumeBootPattern-204955540 May 26 20:31:37.156407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-TestVolumeBootPattern-204955540-project May 26 20:31:37.156407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:31:37.156407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:31:37.156407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: 9558a9c3df27494d990d3b19f560b4d1 May 26 20:31:37.156407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-TestVolumeBootPattern-204955540-project May 26 20:31:37.156407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:31:37.156407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:31:37.156407 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '39113a21-669c-497d-9364-469eec53967d'} May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:31:37.157789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:31:37.159755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:31:37.162815 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-b35a11e7-6b92-4118-ab77-045c79164681 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Returning 404 to user: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:31:37.162815 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-b35a11e7-6b92-4118-ab77-045c79164681 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 404 len: 111 microversion: 2.1 time: 0.033076 May 26 20:31:37.162815 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 439/871] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:37 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 20:31:37.314281 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1988972396", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1889197979", "security_groups": [{"name": "tempest-secgroup-smoke-1530768605"}], "block_device_mapping_v2": [{"uuid": "286f1d6a-67ab-4b7b-80c9-516637b7c6e6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48289956-58c4-46df-a124-8d17ca1f3535"}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:31:37.433147 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] validate_networks() for [('48289956-58c4-46df-a124-8d17ca1f3535', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:31:37.808626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:31:37.809051 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:31:37.809525 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:31:37.809936 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:31:37.810376 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:31:37.819932 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:37.820383 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:37.821184 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:37.821620 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:37.839052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Getting quotas for project 772b1948bd9546669688fe60a8c9ba46. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:31:37.842955 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Getting quotas for user 9558a9c3df27494d990d3b19f560b4d1 and project 772b1948bd9546669688fe60a8c9ba46. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:31:37.900898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:31:37.903139 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='286f1d6a-67ab-4b7b-80c9-516637b7c6e6',volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:31:38.351722 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b3429441-6b8e-478c-839a-c4f53cfeba9f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.042120 May 26 20:31:38.352505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 433/872] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:31:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 20:31:38.366087 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c7a1a557-81bd-4984-85c6-7789941a8747 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:38.366757 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c7a1a557-81bd-4984-85c6-7789941a8747 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:38.420227 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c7a1a557-81bd-4984-85c6-7789941a8747 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:38.428579 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c7a1a557-81bd-4984-85c6-7789941a8747 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1095 microversion: 2.1 time: 0.067755 May 26 20:31:38.429185 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 440/873] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:38 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:39.445867 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d0ae88d0-e43c-4a49-893b-520e24d90f24 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:39.446519 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d0ae88d0-e43c-4a49-893b-520e24d90f24 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:39.452963 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0ae88d0-e43c-4a49-893b-520e24d90f24 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:39.453451 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0ae88d0-e43c-4a49-893b-520e24d90f24 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:39.454203 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0ae88d0-e43c-4a49-893b-520e24d90f24 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:39.454670 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0ae88d0-e43c-4a49-893b-520e24d90f24 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:39.515600 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-d0ae88d0-e43c-4a49-893b-520e24d90f24 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:39.523927 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d0ae88d0-e43c-4a49-893b-520e24d90f24 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1145 microversion: 2.1 time: 0.082955 May 26 20:31:39.524494 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 434/874] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:39 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:40.541338 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-685e6528-645e-40b2-8842-281e384cd3aa tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:40.542022 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-685e6528-645e-40b2-8842-281e384cd3aa tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:40.548647 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-685e6528-645e-40b2-8842-281e384cd3aa tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:40.549097 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-685e6528-645e-40b2-8842-281e384cd3aa tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:40.549860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-685e6528-645e-40b2-8842-281e384cd3aa tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:40.550332 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-685e6528-645e-40b2-8842-281e384cd3aa tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:40.617586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-685e6528-645e-40b2-8842-281e384cd3aa tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:40.624978 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-685e6528-645e-40b2-8842-281e384cd3aa tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1193 microversion: 2.1 time: 0.087642 May 26 20:31:40.625532 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 441/875] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:40 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:41.643673 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fc60e7bb-e416-4834-a8f5-5e36a91939c7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:41.645076 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fc60e7bb-e416-4834-a8f5-5e36a91939c7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:41.653436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc60e7bb-e416-4834-a8f5-5e36a91939c7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:41.654876 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc60e7bb-e416-4834-a8f5-5e36a91939c7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:41.656747 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc60e7bb-e416-4834-a8f5-5e36a91939c7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:41.657736 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fc60e7bb-e416-4834-a8f5-5e36a91939c7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:41.775266 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-fc60e7bb-e416-4834-a8f5-5e36a91939c7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:41.786856 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fc60e7bb-e416-4834-a8f5-5e36a91939c7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1211 microversion: 2.1 time: 0.147850 May 26 20:31:41.787444 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 435/876] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:41 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1211 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:42.812752 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-21c8d0e5-724a-423d-aba6-c0008adef72f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:42.814286 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-21c8d0e5-724a-423d-aba6-c0008adef72f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:42.820936 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-21c8d0e5-724a-423d-aba6-c0008adef72f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:42.823161 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-21c8d0e5-724a-423d-aba6-c0008adef72f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:42.824195 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-21c8d0e5-724a-423d-aba6-c0008adef72f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:42.824854 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-21c8d0e5-724a-423d-aba6-c0008adef72f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:42.984228 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-21c8d0e5-724a-423d-aba6-c0008adef72f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:42.992620 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-21c8d0e5-724a-423d-aba6-c0008adef72f tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1267 microversion: 2.1 time: 0.184448 May 26 20:31:42.993191 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 442/877] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:42 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:43.514925 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-0f5933f1-f804-40cd-846c-44cf66dfac00 req-fe1c4b21-883c-4eb9-a9a8-6b7ad3dd440f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "284492ec-a86d-403a-9bcf-5d02371fad81", "tag": "7aaed27d-d688-4e79-89e9-fc2f3fa5bf3f"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:31:43.527299 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-0f5933f1-f804-40cd-846c-44cf66dfac00 req-fe1c4b21-883c-4eb9-a9a8-6b7ad3dd440f service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:43.534874 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-0f5933f1-f804-40cd-846c-44cf66dfac00 req-fe1c4b21-883c-4eb9-a9a8-6b7ad3dd440f service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:43.543120 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-0f5933f1-f804-40cd-846c-44cf66dfac00 req-fe1c4b21-883c-4eb9-a9a8-6b7ad3dd440f service nova] Creating event network-changed:7aaed27d-d688-4e79-89e9-fc2f3fa5bf3f for instance 284492ec-a86d-403a-9bcf-5d02371fad81 on hv-cinder-84213 May 26 20:31:43.555664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-0f5933f1-f804-40cd-846c-44cf66dfac00 req-fe1c4b21-883c-4eb9-a9a8-6b7ad3dd440f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047617 May 26 20:31:43.556636 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 436/878] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:31:44.009447 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-919dc6c4-bac7-4ad0-9b37-96bbd3340306 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:44.010049 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-919dc6c4-bac7-4ad0-9b37-96bbd3340306 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:44.017603 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-919dc6c4-bac7-4ad0-9b37-96bbd3340306 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:44.018262 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-919dc6c4-bac7-4ad0-9b37-96bbd3340306 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:44.019292 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-919dc6c4-bac7-4ad0-9b37-96bbd3340306 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:44.019830 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-919dc6c4-bac7-4ad0-9b37-96bbd3340306 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:44.187601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-919dc6c4-bac7-4ad0-9b37-96bbd3340306 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:44.197145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-919dc6c4-bac7-4ad0-9b37-96bbd3340306 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1267 microversion: 2.1 time: 0.191811 May 26 20:31:44.197748 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 443/879] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:44 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:45.216575 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-2c9de7fd-2014-40d3-a4da-f82860ac6f87 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:45.217882 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-2c9de7fd-2014-40d3-a4da-f82860ac6f87 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:45.224651 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c9de7fd-2014-40d3-a4da-f82860ac6f87 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:45.225331 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c9de7fd-2014-40d3-a4da-f82860ac6f87 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:45.226103 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c9de7fd-2014-40d3-a4da-f82860ac6f87 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:45.226734 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-2c9de7fd-2014-40d3-a4da-f82860ac6f87 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:45.411786 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-2c9de7fd-2014-40d3-a4da-f82860ac6f87 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:45.420226 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-2c9de7fd-2014-40d3-a4da-f82860ac6f87 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1267 microversion: 2.1 time: 0.208625 May 26 20:31:45.421029 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 437/880] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:45 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:46.439138 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-178a3b05-c734-4040-88b2-5d163170a860 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:46.440392 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-178a3b05-c734-4040-88b2-5d163170a860 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:46.446889 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-178a3b05-c734-4040-88b2-5d163170a860 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:46.447682 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-178a3b05-c734-4040-88b2-5d163170a860 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:46.448683 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-178a3b05-c734-4040-88b2-5d163170a860 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:46.449455 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-178a3b05-c734-4040-88b2-5d163170a860 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:46.603543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-178a3b05-c734-4040-88b2-5d163170a860 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:46.614839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-178a3b05-c734-4040-88b2-5d163170a860 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1267 microversion: 2.1 time: 0.179641 May 26 20:31:46.625183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 444/881] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:46 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:47.633022 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-09782282-f8a5-4913-ba7c-f7e7cecefc90 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:47.633643 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-09782282-f8a5-4913-ba7c-f7e7cecefc90 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:47.641361 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09782282-f8a5-4913-ba7c-f7e7cecefc90 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:47.641813 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09782282-f8a5-4913-ba7c-f7e7cecefc90 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:47.642615 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09782282-f8a5-4913-ba7c-f7e7cecefc90 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:47.643055 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-09782282-f8a5-4913-ba7c-f7e7cecefc90 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:47.830427 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-09782282-f8a5-4913-ba7c-f7e7cecefc90 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:47.830427 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-09782282-f8a5-4913-ba7c-f7e7cecefc90 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1267 microversion: 2.1 time: 0.152770 May 26 20:31:47.830427 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 438/882] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:47 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:48.847289 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-33ba66c8-3072-4ca7-a052-eeda139b1a98 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:48.848874 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-33ba66c8-3072-4ca7-a052-eeda139b1a98 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:48.851218 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:48.859188 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-33ba66c8-3072-4ca7-a052-eeda139b1a98 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:48.859675 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-33ba66c8-3072-4ca7-a052-eeda139b1a98 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:48.862929 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-33ba66c8-3072-4ca7-a052-eeda139b1a98 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:48.862929 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-33ba66c8-3072-4ca7-a052-eeda139b1a98 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:49.026526 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-33ba66c8-3072-4ca7-a052-eeda139b1a98 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:49.038896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-33ba66c8-3072-4ca7-a052-eeda139b1a98 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1267 microversion: 2.1 time: 0.195535 May 26 20:31:49.040146 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 445/883] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:48 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:50.056357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-97e037cf-1fe8-4743-9d25-fd09cb9573e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:50.057014 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-97e037cf-1fe8-4743-9d25-fd09cb9573e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:50.059164 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:50.059777 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:50.066029 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e037cf-1fe8-4743-9d25-fd09cb9573e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:50.073385 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e037cf-1fe8-4743-9d25-fd09cb9573e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:50.073385 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e037cf-1fe8-4743-9d25-fd09cb9573e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:50.073385 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97e037cf-1fe8-4743-9d25-fd09cb9573e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:50.215329 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-97e037cf-1fe8-4743-9d25-fd09cb9573e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:50.224555 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-97e037cf-1fe8-4743-9d25-fd09cb9573e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1267 microversion: 2.1 time: 0.171993 May 26 20:31:50.225385 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 439/884] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:50 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:51.244350 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-26779971-ec97-45e6-8c68-db612746598e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:51.245060 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-26779971-ec97-45e6-8c68-db612746598e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:51.252601 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-26779971-ec97-45e6-8c68-db612746598e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:51.252940 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-26779971-ec97-45e6-8c68-db612746598e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:51.253800 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-26779971-ec97-45e6-8c68-db612746598e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:51.254929 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-26779971-ec97-45e6-8c68-db612746598e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:51.411626 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-26779971-ec97-45e6-8c68-db612746598e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:51.419794 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-26779971-ec97-45e6-8c68-db612746598e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1267 microversion: 2.1 time: 0.181385 May 26 20:31:51.420372 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 446/885] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:51 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:52.437781 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-92f51539-478f-4052-9617-459b7d10ee3e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:52.439594 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-92f51539-478f-4052-9617-459b7d10ee3e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:52.449152 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-92f51539-478f-4052-9617-459b7d10ee3e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:52.450514 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-92f51539-478f-4052-9617-459b7d10ee3e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:52.451788 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-92f51539-478f-4052-9617-459b7d10ee3e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:52.452373 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-92f51539-478f-4052-9617-459b7d10ee3e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:52.635389 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-92f51539-478f-4052-9617-459b7d10ee3e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:52.647829 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-92f51539-478f-4052-9617-459b7d10ee3e tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1267 microversion: 2.1 time: 0.213864 May 26 20:31:52.653887 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 440/886] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:52 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:53.671154 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-19def481-e5d6-42b9-ac45-79170406adb9 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:53.671817 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-19def481-e5d6-42b9-ac45-79170406adb9 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:53.679242 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-19def481-e5d6-42b9-ac45-79170406adb9 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:53.679704 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-19def481-e5d6-42b9-ac45-79170406adb9 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:53.680578 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-19def481-e5d6-42b9-ac45-79170406adb9 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:53.681018 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-19def481-e5d6-42b9-ac45-79170406adb9 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:53.849465 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-19def481-e5d6-42b9-ac45-79170406adb9 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:53.857668 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-19def481-e5d6-42b9-ac45-79170406adb9 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1267 microversion: 2.1 time: 0.190652 May 26 20:31:53.867079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 447/887] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:53 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:54.294020 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-94814049-a559-4d9d-968e-0b89ba72f1a8 req-7f87f9e3-da55-46dc-9f8c-bb200111b6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284492ec-a86d-403a-9bcf-5d02371fad81", "name": "network-vif-plugged", "status": "completed", "tag": "7aaed27d-d688-4e79-89e9-fc2f3fa5bf3f"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:31:54.303345 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-94814049-a559-4d9d-968e-0b89ba72f1a8 req-7f87f9e3-da55-46dc-9f8c-bb200111b6b6 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:54.304230 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-94814049-a559-4d9d-968e-0b89ba72f1a8 req-7f87f9e3-da55-46dc-9f8c-bb200111b6b6 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:54.317422 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-94814049-a559-4d9d-968e-0b89ba72f1a8 req-7f87f9e3-da55-46dc-9f8c-bb200111b6b6 service nova] Creating event network-vif-plugged:7aaed27d-d688-4e79-89e9-fc2f3fa5bf3f for instance 284492ec-a86d-403a-9bcf-5d02371fad81 on hv-cinder-84213 May 26 20:31:54.323164 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-94814049-a559-4d9d-968e-0b89ba72f1a8 req-7f87f9e3-da55-46dc-9f8c-bb200111b6b6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032754 May 26 20:31:54.324022 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 441/888] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:31:54.874046 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-531931f8-dcee-4d8d-a784-79434c8f4a28 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:54.874718 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-531931f8-dcee-4d8d-a784-79434c8f4a28 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:54.884575 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-531931f8-dcee-4d8d-a784-79434c8f4a28 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:54.885412 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-531931f8-dcee-4d8d-a784-79434c8f4a28 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:54.886508 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-531931f8-dcee-4d8d-a784-79434c8f4a28 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:54.887209 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-531931f8-dcee-4d8d-a784-79434c8f4a28 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:55.057256 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-531931f8-dcee-4d8d-a784-79434c8f4a28 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:55.072912 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-531931f8-dcee-4d8d-a784-79434c8f4a28 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1267 microversion: 2.1 time: 0.202356 May 26 20:31:55.074817 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 448/889] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:54 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:31:56.094997 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-98f1147a-1bce-4433-94aa-0264be1a24d7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:56.095734 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-98f1147a-1bce-4433-94aa-0264be1a24d7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:56.104933 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98f1147a-1bce-4433-94aa-0264be1a24d7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:56.105497 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98f1147a-1bce-4433-94aa-0264be1a24d7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:56.106312 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98f1147a-1bce-4433-94aa-0264be1a24d7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:56.106754 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-98f1147a-1bce-4433-94aa-0264be1a24d7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:56.258934 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-98f1147a-1bce-4433-94aa-0264be1a24d7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:56.267475 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-98f1147a-1bce-4433-94aa-0264be1a24d7 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1267 microversion: 2.1 time: 0.179023 May 26 20:31:56.268256 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 442/890] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:56 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:57.286203 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-94032f2a-8ca3-4b38-9acb-b822d2667aab tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:57.287681 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-94032f2a-8ca3-4b38-9acb-b822d2667aab tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:57.293832 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:57.295286 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-94032f2a-8ca3-4b38-9acb-b822d2667aab tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:57.295922 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-94032f2a-8ca3-4b38-9acb-b822d2667aab tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:57.296735 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-94032f2a-8ca3-4b38-9acb-b822d2667aab tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:57.297384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-94032f2a-8ca3-4b38-9acb-b822d2667aab tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:57.445491 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-94032f2a-8ca3-4b38-9acb-b822d2667aab tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:57.453533 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-94032f2a-8ca3-4b38-9acb-b822d2667aab tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1454 microversion: 2.1 time: 0.171140 May 26 20:31:57.454103 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 449/891] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:57 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:57.474671 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eb16e4fc-5a65-464f-a25d-2cb929ff9903 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:31:57.479374 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eb16e4fc-5a65-464f-a25d-2cb929ff9903 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:31:57.481802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb16e4fc-5a65-464f-a25d-2cb929ff9903 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:57.482292 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb16e4fc-5a65-464f-a25d-2cb929ff9903 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:57.483076 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb16e4fc-5a65-464f-a25d-2cb929ff9903 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:57.483591 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eb16e4fc-5a65-464f-a25d-2cb929ff9903 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:57.624518 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-eb16e4fc-5a65-464f-a25d-2cb929ff9903 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:31:57.633440 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eb16e4fc-5a65-464f-a25d-2cb929ff9903 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1454 microversion: 2.1 time: 0.162720 May 26 20:31:57.634028 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 443/892] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:31:57 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:31:59.758739 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-e0d228c8-183c-46e8-9c87-f4c60054d81d req-e39f46b3-517a-4c30-9462-844bd0e378c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "284492ec-a86d-403a-9bcf-5d02371fad81", "tag": "7aaed27d-d688-4e79-89e9-fc2f3fa5bf3f"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:31:59.769046 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-e0d228c8-183c-46e8-9c87-f4c60054d81d req-e39f46b3-517a-4c30-9462-844bd0e378c2 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:31:59.769534 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-e0d228c8-183c-46e8-9c87-f4c60054d81d req-e39f46b3-517a-4c30-9462-844bd0e378c2 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:31:59.781529 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-e0d228c8-183c-46e8-9c87-f4c60054d81d req-e39f46b3-517a-4c30-9462-844bd0e378c2 service nova] Creating event network-changed:7aaed27d-d688-4e79-89e9-fc2f3fa5bf3f for instance 284492ec-a86d-403a-9bcf-5d02371fad81 on hv-cinder-84213 May 26 20:31:59.787497 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-e0d228c8-183c-46e8-9c87-f4c60054d81d req-e39f46b3-517a-4c30-9462-844bd0e378c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033566 May 26 20:31:59.787805 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 450/893] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:32:02.829725 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-97c27454-04b9-41b2-b654-940c3cdbeee1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:02.830328 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-97c27454-04b9-41b2-b654-940c3cdbeee1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:02.833153 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:32:02.837901 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97c27454-04b9-41b2-b654-940c3cdbeee1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:02.838640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97c27454-04b9-41b2-b654-940c3cdbeee1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:02.839406 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97c27454-04b9-41b2-b654-940c3cdbeee1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:02.839847 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-97c27454-04b9-41b2-b654-940c3cdbeee1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:02.870652 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-97c27454-04b9-41b2-b654-940c3cdbeee1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/os-volume_attachments/02c2b962-e262-478e-b7f5-b7f3bea203c8" status: 200 len: 194 microversion: 2.20 time: 0.044952 May 26 20:32:02.871277 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 444/894] 10.222.0.44 () {60 vars in 1453 bytes} [Thu May 26 20:32:02 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/os-volume_attachments/02c2b962-e262-478e-b7f5-b7f3bea203c8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:32:02.936717 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7b27975e-2490-4b26-8422-fac9d098f624 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:02.939188 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7b27975e-2490-4b26-8422-fac9d098f624 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:02.944268 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7b27975e-2490-4b26-8422-fac9d098f624 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:02.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7b27975e-2490-4b26-8422-fac9d098f624 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:02.945464 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7b27975e-2490-4b26-8422-fac9d098f624 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:02.945894 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7b27975e-2490-4b26-8422-fac9d098f624 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:03.026689 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-7b27975e-2490-4b26-8422-fac9d098f624 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lazy-loading 'services' on Instance uuid 419dd0d9-334f-4481-aa27-8c24115614db {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:32:03.318832 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7b27975e-2490-4b26-8422-fac9d098f624 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "DELETE /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/os-volume_attachments/02c2b962-e262-478e-b7f5-b7f3bea203c8" status: 202 len: 0 microversion: 2.20 time: 0.386704 May 26 20:32:03.319448 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 451/895] 10.222.0.44 () {60 vars in 1456 bytes} [Thu May 26 20:32:02 2022] DELETE /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/os-volume_attachments/02c2b962-e262-478e-b7f5-b7f3bea203c8 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 20:32:03.328652 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f899091f-1d03-40ae-836e-4884d7c41928 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:03.329574 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f899091f-1d03-40ae-836e-4884d7c41928 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:03.336502 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f899091f-1d03-40ae-836e-4884d7c41928 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:03.339579 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f899091f-1d03-40ae-836e-4884d7c41928 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:03.339579 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f899091f-1d03-40ae-836e-4884d7c41928 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:03.339579 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f899091f-1d03-40ae-836e-4884d7c41928 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:03.369408 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f899091f-1d03-40ae-836e-4884d7c41928 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045474 May 26 20:32:03.369979 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 445/896] 10.222.0.44 () {60 vars in 1342 bytes} [Thu May 26 20:32:03 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:32:04.382935 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-a4b55e6c-0c8d-4976-a56c-c6bba22017b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:04.383938 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-a4b55e6c-0c8d-4976-a56c-c6bba22017b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:04.390191 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a4b55e6c-0c8d-4976-a56c-c6bba22017b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:04.390724 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a4b55e6c-0c8d-4976-a56c-c6bba22017b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:04.391477 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a4b55e6c-0c8d-4976-a56c-c6bba22017b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:04.391905 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-a4b55e6c-0c8d-4976-a56c-c6bba22017b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:04.419741 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-a4b55e6c-0c8d-4976-a56c-c6bba22017b3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042350 May 26 20:32:04.420297 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 452/897] 10.222.0.44 () {60 vars in 1342 bytes} [Thu May 26 20:32:04 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:32:04.481188 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e913a266-7322-4ab1-a4d5-c67b4533e44c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:04.481700 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e913a266-7322-4ab1-a4d5-c67b4533e44c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:04.489347 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e913a266-7322-4ab1-a4d5-c67b4533e44c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:04.490019 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e913a266-7322-4ab1-a4d5-c67b4533e44c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:04.490604 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e913a266-7322-4ab1-a4d5-c67b4533e44c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:04.491047 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e913a266-7322-4ab1-a4d5-c67b4533e44c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:04.494992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=84 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:32:04.516668 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e913a266-7322-4ab1-a4d5-c67b4533e44c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:32:04.806781 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e913a266-7322-4ab1-a4d5-c67b4533e44c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "DELETE /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 204 len: 0 microversion: 2.20 time: 0.329227 May 26 20:32:04.807374 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 446/898] 10.222.0.44 () {60 vars in 1279 bytes} [Thu May 26 20:32:04 2022] DELETE /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 20:32:04.816913 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cc700a95-c18c-41d1-811e-5d902e3aef90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:04.818179 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-cc700a95-c18c-41d1-811e-5d902e3aef90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:04.824140 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cc700a95-c18c-41d1-811e-5d902e3aef90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:04.824590 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cc700a95-c18c-41d1-811e-5d902e3aef90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:04.825341 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cc700a95-c18c-41d1-811e-5d902e3aef90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:04.825773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cc700a95-c18c-41d1-811e-5d902e3aef90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:04.955976 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cc700a95-c18c-41d1-811e-5d902e3aef90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:04.965127 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cc700a95-c18c-41d1-811e-5d902e3aef90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:04.966669 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cc700a95-c18c-41d1-811e-5d902e3aef90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:04.967837 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-cc700a95-c18c-41d1-811e-5d902e3aef90 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.156282 May 26 20:32:04.968600 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 453/899] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:04 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:05.986849 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b36f525c-60e6-45dc-b345-f1996564857d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:05.987559 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b36f525c-60e6-45dc-b345-f1996564857d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:05.994388 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b36f525c-60e6-45dc-b345-f1996564857d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:05.994849 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b36f525c-60e6-45dc-b345-f1996564857d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:05.995620 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b36f525c-60e6-45dc-b345-f1996564857d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:05.996062 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b36f525c-60e6-45dc-b345-f1996564857d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:06.130088 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b36f525c-60e6-45dc-b345-f1996564857d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:06.138480 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b36f525c-60e6-45dc-b345-f1996564857d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:06.139993 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b36f525c-60e6-45dc-b345-f1996564857d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:06.141157 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b36f525c-60e6-45dc-b345-f1996564857d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1722 microversion: 2.20 time: 0.158718 May 26 20:32:06.141720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 447/900] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:05 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:07.159698 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6ddbbeaf-7adb-4487-87b0-bb81a4b1d9b6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:07.160931 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6ddbbeaf-7adb-4487-87b0-bb81a4b1d9b6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:07.167679 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6ddbbeaf-7adb-4487-87b0-bb81a4b1d9b6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:07.168132 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6ddbbeaf-7adb-4487-87b0-bb81a4b1d9b6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:07.168918 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6ddbbeaf-7adb-4487-87b0-bb81a4b1d9b6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:07.169355 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6ddbbeaf-7adb-4487-87b0-bb81a4b1d9b6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:07.173598 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:32:07.232815 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6ddbbeaf-7adb-4487-87b0-bb81a4b1d9b6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:07.242036 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6ddbbeaf-7adb-4487-87b0-bb81a4b1d9b6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:07.243599 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6ddbbeaf-7adb-4487-87b0-bb81a4b1d9b6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:07.244944 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6ddbbeaf-7adb-4487-87b0-bb81a4b1d9b6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1655 microversion: 2.20 time: 0.089172 May 26 20:32:07.245744 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 454/901] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:07 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:07.404101 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-6477a1bc-e891-4759-9f99-63689432b578 req-d68eb310-2926-4817-a7c5-1e0f0fdeecf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419dd0d9-334f-4481-aa27-8c24115614db", "name": "network-vif-deleted", "tag": "9ff1ecd8-c0e6-4014-b5c2-850b82d549df"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:32:07.414690 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-6477a1bc-e891-4759-9f99-63689432b578 req-d68eb310-2926-4817-a7c5-1e0f0fdeecf9 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:07.415056 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-6477a1bc-e891-4759-9f99-63689432b578 req-d68eb310-2926-4817-a7c5-1e0f0fdeecf9 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:07.427668 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-6477a1bc-e891-4759-9f99-63689432b578 req-d68eb310-2926-4817-a7c5-1e0f0fdeecf9 service nova] Creating event network-vif-deleted:9ff1ecd8-c0e6-4014-b5c2-850b82d549df for instance 419dd0d9-334f-4481-aa27-8c24115614db on hv-cinder-84213 May 26 20:32:07.442184 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-6477a1bc-e891-4759-9f99-63689432b578 req-d68eb310-2926-4817-a7c5-1e0f0fdeecf9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032978 May 26 20:32:07.442184 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 448/902] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:32:08.263477 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:08.264092 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:08.272234 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:08.272626 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:08.273403 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:08.273843 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:08.322047 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:08.322527 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:08.322990 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.objects.instance [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lazy-loading 'fault' on Instance uuid 419dd0d9-334f-4481-aa27-8c24115614db {{(pid=118306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:32:08.373432 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:08.381622 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:08.383235 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:08.384393 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-48421e74-603a-473b-93fb-c8d0787cb48f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 200 len: 1371 microversion: 2.20 time: 0.125376 May 26 20:32:08.385280 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 455/903] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:08 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:09.403888 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c197710d-b7cb-498b-abc1-4183b1216e5a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:09.404588 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c197710d-b7cb-498b-abc1-4183b1216e5a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:09.411601 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c197710d-b7cb-498b-abc1-4183b1216e5a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:09.412052 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c197710d-b7cb-498b-abc1-4183b1216e5a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:09.412816 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c197710d-b7cb-498b-abc1-4183b1216e5a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:09.413256 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c197710d-b7cb-498b-abc1-4183b1216e5a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:09.426959 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-c197710d-b7cb-498b-abc1-4183b1216e5a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] HTTP exception thrown: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c197710d-b7cb-498b-abc1-4183b1216e5a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Request method failure captured: May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db HTTP/1.1 May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-MStVNRquOEBB0j7pTT50IiiMc7Jgl--9w_JdLQRGwbTW8-agHKiXTnBTyqUB4aWgxQEUa7ADpuHJZvac095kGR-6etdDDi7NLr4g5ng744pFbINSCSL55Na_kmu50uv656rSHrV7X2prCCdBSAsRhR61v4hv_wGSUAdD-1XyGywjc May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Openstack-Nova-Api-Version: 2.20 May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 4df1452f8d474ea9b121f4aef1793af8 May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:32:09.428910 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:32:09.430763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:32:09.430763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:32:09.430763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 4df1452f8d474ea9b121f4aef1793af8 May 26 20:32:09.430763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:32:09.430763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeShelveTestJSON-958965953-project May 26 20:32:09.430763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:32:09.430763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:32:09.430763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 2ecdb952539f401aba5e0f91c3dd8660 May 26 20:32:09.430763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-958965953-project May 26 20:32:09.430763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:32:09.430763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:32:09.430763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '419dd0d9-334f-4481-aa27-8c24115614db'} May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:32:09.431656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:32:09.433026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:32:09.434470 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c197710d-b7cb-498b-abc1-4183b1216e5a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Returning 404 to user: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:32:09.434470 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c197710d-b7cb-498b-abc1-4183b1216e5a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 404 len: 111 microversion: 2.20 time: 0.030829 May 26 20:32:09.434470 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 449/904] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:09 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 20:32:09.439598 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-36604dc2-5caf-4efc-bed8-f73e53926ad9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '.version_select at 0x7f2da445b310>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:09.515240 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-36604dc2-5caf-4efc-bed8-f73e53926ad9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401384039" status: 204 len: 0 microversion: 2.20 time: 0.079504 May 26 20:32:09.515823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 456/905] 10.222.0.44 () {60 vars in 1261 bytes} [Thu May 26 20:32:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401384039 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 20:32:10.330382 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1c62aea5-e113-4e90-b584-524c013ea107 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Action: 'create', calling method: .version_select at 0x7f2da4552790>, body: {"keypair": {"name": "tempest-keypair-427037837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvlou7wplgS6u1vhAntGYaf8JnLPccAu05DrptMDF6xrALZkhoDG7UOyLGnmJAE6qxYvuqrciCwjAMCYKKgSlvOqHDM74iwovwXzCoYrC+DhP4tX6NFbCZiHjcQkb2vPw=="}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:32:10.346042 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-1c62aea5-e113-4e90-b584-524c013ea107 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Getting quotas for project 4df1452f8d474ea9b121f4aef1793af8. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:32:10.350021 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-1c62aea5-e113-4e90-b584-524c013ea107 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Getting quotas for user 2ecdb952539f401aba5e0f91c3dd8660 and project 4df1452f8d474ea9b121f4aef1793af8. Resources: {'key_pairs'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:32:10.453369 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1c62aea5-e113-4e90-b584-524c013ea107 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.126870 May 26 20:32:10.454074 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 450/906] 10.222.0.44 () {62 vars in 1199 bytes} [Thu May 26 20:32:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 20:32:12.738005 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1605200491", "imageRef": "448a120d-5747-48b7-95d5-21a93b3fec20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89de8b4f-17f7-4ec4-b9e8-10249db26cfe"}], "security_groups": [{"name": "tempest-securitygroup--1213468349"}], "key_name": "tempest-keypair-427037837", "user_data": "}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:32:12.840966 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.network.neutron [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] validate_networks() for [('89de8b4f-17f7-4ec4-b9e8-10249db26cfe', None, None, None, None, None)] {{(pid=118306) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:32:13.217642 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Flavor limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:32:13.218067 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Image limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:32:13.218588 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Flavor pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:32:13.219027 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Image pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:32:13.219441 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:32:13.228541 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:13.228989 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:13.229814 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:13.230261 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:13.247443 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Getting quotas for project 4df1452f8d474ea9b121f4aef1793af8. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:32:13.253479 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Getting quotas for user 2ecdb952539f401aba5e0f91c3dd8660 and project 4df1452f8d474ea9b121f4aef1793af8. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:32:13.264783 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Going to run 1 instances... {{(pid=118306) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:32:13.267102 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448a120d-5747-48b7-95d5-21a93b3fec20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:32:13.382436 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7161a00c-eff2-4c40-8117-3ac8a7534c64 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.648651 May 26 20:32:13.383473 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 457/907] 10.222.0.44 () {62 vars in 1187 bytes} [Thu May 26 20:32:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 20:32:13.394389 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f7543cff-6671-4131-9515-b88c57c63e8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:13.395158 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f7543cff-6671-4131-9515-b88c57c63e8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:13.451352 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f7543cff-6671-4131-9515-b88c57c63e8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:13.458491 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f7543cff-6671-4131-9515-b88c57c63e8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:13.460129 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f7543cff-6671-4131-9515-b88c57c63e8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:13.461231 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f7543cff-6671-4131-9515-b88c57c63e8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1281 microversion: 2.20 time: 0.071655 May 26 20:32:13.461780 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 451/908] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:13 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:14.479535 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-be1066de-7166-4ebd-9a9e-10475bb1238e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:14.480385 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-be1066de-7166-4ebd-9a9e-10475bb1238e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:14.488231 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-be1066de-7166-4ebd-9a9e-10475bb1238e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:14.488677 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-be1066de-7166-4ebd-9a9e-10475bb1238e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:14.489525 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-be1066de-7166-4ebd-9a9e-10475bb1238e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:14.490041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-be1066de-7166-4ebd-9a9e-10475bb1238e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:14.560236 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-be1066de-7166-4ebd-9a9e-10475bb1238e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:14.568625 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-be1066de-7166-4ebd-9a9e-10475bb1238e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:14.570666 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-be1066de-7166-4ebd-9a9e-10475bb1238e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:14.571768 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-be1066de-7166-4ebd-9a9e-10475bb1238e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1277 microversion: 2.20 time: 0.097189 May 26 20:32:14.572328 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 458/909] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:14 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:15.592986 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-bb36f4a3-47db-457f-950c-8b205eec8b41 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:15.593669 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-bb36f4a3-47db-457f-950c-8b205eec8b41 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:15.602202 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb36f4a3-47db-457f-950c-8b205eec8b41 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:15.602701 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb36f4a3-47db-457f-950c-8b205eec8b41 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:15.603559 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb36f4a3-47db-457f-950c-8b205eec8b41 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:15.604004 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bb36f4a3-47db-457f-950c-8b205eec8b41 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:15.668292 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-bb36f4a3-47db-457f-950c-8b205eec8b41 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:15.676703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-bb36f4a3-47db-457f-950c-8b205eec8b41 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:15.678305 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-bb36f4a3-47db-457f-950c-8b205eec8b41 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:15.682345 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-bb36f4a3-47db-457f-950c-8b205eec8b41 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1351 microversion: 2.20 time: 0.091213 May 26 20:32:15.682345 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 452/910] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:15 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:16.697123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-96815d81-cf16-42a8-b829-8bc41767105d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:16.697989 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-96815d81-cf16-42a8-b829-8bc41767105d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:16.704249 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-96815d81-cf16-42a8-b829-8bc41767105d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:16.704777 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-96815d81-cf16-42a8-b829-8bc41767105d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:16.705603 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-96815d81-cf16-42a8-b829-8bc41767105d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:16.706125 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-96815d81-cf16-42a8-b829-8bc41767105d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:16.847465 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-96815d81-cf16-42a8-b829-8bc41767105d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:16.856992 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-96815d81-cf16-42a8-b829-8bc41767105d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:16.858818 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-96815d81-cf16-42a8-b829-8bc41767105d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:16.860182 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-96815d81-cf16-42a8-b829-8bc41767105d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1407 microversion: 2.20 time: 0.167216 May 26 20:32:16.860990 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 459/911] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:16 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:17.024646 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-257e61cc-db52-49c6-a867-d0b8aca7a71d req-b2962a4d-0fdd-447c-9bf6-09aed7e18b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e8a714b-7c67-466b-8448-e5a66aa434ee", "tag": "8aa75e2d-2a2c-43bc-809a-e911f84bfa6e"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:32:17.033080 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-257e61cc-db52-49c6-a867-d0b8aca7a71d req-b2962a4d-0fdd-447c-9bf6-09aed7e18b55 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:17.037978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-257e61cc-db52-49c6-a867-d0b8aca7a71d req-b2962a4d-0fdd-447c-9bf6-09aed7e18b55 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:17.045163 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-257e61cc-db52-49c6-a867-d0b8aca7a71d req-b2962a4d-0fdd-447c-9bf6-09aed7e18b55 service nova] Creating event network-changed:8aa75e2d-2a2c-43bc-809a-e911f84bfa6e for instance 0e8a714b-7c67-466b-8448-e5a66aa434ee on hv-cinder-84213 May 26 20:32:17.052128 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-257e61cc-db52-49c6-a867-d0b8aca7a71d req-b2962a4d-0fdd-447c-9bf6-09aed7e18b55 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031491 May 26 20:32:17.053584 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 453/912] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:32:17.878995 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ecded5e4-7893-4931-a987-8c977ca4760b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:17.879607 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ecded5e4-7893-4931-a987-8c977ca4760b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:17.886342 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ecded5e4-7893-4931-a987-8c977ca4760b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:17.886795 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ecded5e4-7893-4931-a987-8c977ca4760b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:17.887562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ecded5e4-7893-4931-a987-8c977ca4760b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:17.888001 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ecded5e4-7893-4931-a987-8c977ca4760b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:18.016781 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ecded5e4-7893-4931-a987-8c977ca4760b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:18.025228 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ecded5e4-7893-4931-a987-8c977ca4760b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:18.026764 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ecded5e4-7893-4931-a987-8c977ca4760b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:18.027872 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ecded5e4-7893-4931-a987-8c977ca4760b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1407 microversion: 2.20 time: 0.152855 May 26 20:32:18.028434 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 460/913] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:17 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:19.047490 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ebd0dd30-d008-4826-b733-4dc5c76f1ea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:19.048373 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ebd0dd30-d008-4826-b733-4dc5c76f1ea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:19.055804 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ebd0dd30-d008-4826-b733-4dc5c76f1ea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:19.056258 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ebd0dd30-d008-4826-b733-4dc5c76f1ea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:19.057043 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ebd0dd30-d008-4826-b733-4dc5c76f1ea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:19.057488 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ebd0dd30-d008-4826-b733-4dc5c76f1ea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:19.194822 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ebd0dd30-d008-4826-b733-4dc5c76f1ea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:19.203308 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ebd0dd30-d008-4826-b733-4dc5c76f1ea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:19.204823 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ebd0dd30-d008-4826-b733-4dc5c76f1ea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:19.205979 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ebd0dd30-d008-4826-b733-4dc5c76f1ea4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1407 microversion: 2.20 time: 0.163472 May 26 20:32:19.206672 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 454/914] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:19 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:20.225727 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-fd3e1e30-88cf-444d-a7c7-542b33ae7a50 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:20.226633 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-fd3e1e30-88cf-444d-a7c7-542b33ae7a50 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:20.234384 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fd3e1e30-88cf-444d-a7c7-542b33ae7a50 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:20.234914 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fd3e1e30-88cf-444d-a7c7-542b33ae7a50 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:20.235829 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fd3e1e30-88cf-444d-a7c7-542b33ae7a50 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:20.236346 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-fd3e1e30-88cf-444d-a7c7-542b33ae7a50 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:20.372610 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-fd3e1e30-88cf-444d-a7c7-542b33ae7a50 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:20.380768 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-fd3e1e30-88cf-444d-a7c7-542b33ae7a50 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:20.382743 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-fd3e1e30-88cf-444d-a7c7-542b33ae7a50 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:20.383864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-fd3e1e30-88cf-444d-a7c7-542b33ae7a50 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1407 microversion: 2.20 time: 0.162980 May 26 20:32:20.384424 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 461/915] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:20 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:21.402513 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-0d143c03-e5b3-48f0-9dc8-70d9d4f91e4a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:21.403199 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-0d143c03-e5b3-48f0-9dc8-70d9d4f91e4a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:21.410176 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d143c03-e5b3-48f0-9dc8-70d9d4f91e4a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:21.410669 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d143c03-e5b3-48f0-9dc8-70d9d4f91e4a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:21.411440 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d143c03-e5b3-48f0-9dc8-70d9d4f91e4a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:21.411891 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-0d143c03-e5b3-48f0-9dc8-70d9d4f91e4a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:21.540138 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-0d143c03-e5b3-48f0-9dc8-70d9d4f91e4a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:21.548166 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-0d143c03-e5b3-48f0-9dc8-70d9d4f91e4a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:21.549664 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-0d143c03-e5b3-48f0-9dc8-70d9d4f91e4a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:21.550810 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-0d143c03-e5b3-48f0-9dc8-70d9d4f91e4a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1407 microversion: 2.20 time: 0.152460 May 26 20:32:21.551367 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 455/916] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:21 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:22.222864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-311fb429-fb1f-496b-a6ed-ab2d3a4b5a77 req-acc418e9-fafc-4814-ba4e-67853cb00fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a714b-7c67-466b-8448-e5a66aa434ee", "name": "network-vif-plugged", "status": "completed", "tag": "8aa75e2d-2a2c-43bc-809a-e911f84bfa6e"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:32:22.232581 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-311fb429-fb1f-496b-a6ed-ab2d3a4b5a77 req-acc418e9-fafc-4814-ba4e-67853cb00fe3 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:22.233024 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-311fb429-fb1f-496b-a6ed-ab2d3a4b5a77 req-acc418e9-fafc-4814-ba4e-67853cb00fe3 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:22.244040 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-311fb429-fb1f-496b-a6ed-ab2d3a4b5a77 req-acc418e9-fafc-4814-ba4e-67853cb00fe3 service nova] Creating event network-vif-plugged:8aa75e2d-2a2c-43bc-809a-e911f84bfa6e for instance 0e8a714b-7c67-466b-8448-e5a66aa434ee on hv-cinder-84213 May 26 20:32:22.248989 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-311fb429-fb1f-496b-a6ed-ab2d3a4b5a77 req-acc418e9-fafc-4814-ba4e-67853cb00fe3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029933 May 26 20:32:22.249598 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 462/917] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:32:22.568837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-76ffa14a-11f9-49a5-a006-443e44dc8699 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:22.569508 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-76ffa14a-11f9-49a5-a006-443e44dc8699 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:22.576328 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-76ffa14a-11f9-49a5-a006-443e44dc8699 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:22.576714 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-76ffa14a-11f9-49a5-a006-443e44dc8699 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:22.577499 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-76ffa14a-11f9-49a5-a006-443e44dc8699 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:22.577942 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-76ffa14a-11f9-49a5-a006-443e44dc8699 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:22.708101 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-76ffa14a-11f9-49a5-a006-443e44dc8699 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:22.717230 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-76ffa14a-11f9-49a5-a006-443e44dc8699 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:22.718795 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-76ffa14a-11f9-49a5-a006-443e44dc8699 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:22.720907 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-76ffa14a-11f9-49a5-a006-443e44dc8699 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1407 microversion: 2.20 time: 0.154894 May 26 20:32:22.720907 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 456/918] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:22 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:23.738586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-f6951808-aa57-49d2-a65d-e4b7e6c844f0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:23.739279 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-f6951808-aa57-49d2-a65d-e4b7e6c844f0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:23.741937 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:32:23.742608 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=6 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:32:23.747734 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f6951808-aa57-49d2-a65d-e4b7e6c844f0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:23.748179 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f6951808-aa57-49d2-a65d-e4b7e6c844f0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:23.749532 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f6951808-aa57-49d2-a65d-e4b7e6c844f0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:23.749532 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f6951808-aa57-49d2-a65d-e4b7e6c844f0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:23.892758 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-f6951808-aa57-49d2-a65d-e4b7e6c844f0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:23.901467 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-f6951808-aa57-49d2-a65d-e4b7e6c844f0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:23.902966 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-f6951808-aa57-49d2-a65d-e4b7e6c844f0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:23.904061 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-f6951808-aa57-49d2-a65d-e4b7e6c844f0 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1407 microversion: 2.20 time: 0.169859 May 26 20:32:23.906009 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 463/919] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:23 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:24.921984 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b2d80a06-c1fd-489c-a05e-f7b2137bd626 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:24.922645 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b2d80a06-c1fd-489c-a05e-f7b2137bd626 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:24.924644 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:32:24.931017 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2d80a06-c1fd-489c-a05e-f7b2137bd626 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:24.931493 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2d80a06-c1fd-489c-a05e-f7b2137bd626 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:24.932263 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2d80a06-c1fd-489c-a05e-f7b2137bd626 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:24.932700 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b2d80a06-c1fd-489c-a05e-f7b2137bd626 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:25.060665 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b2d80a06-c1fd-489c-a05e-f7b2137bd626 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:25.068775 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b2d80a06-c1fd-489c-a05e-f7b2137bd626 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:25.070316 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b2d80a06-c1fd-489c-a05e-f7b2137bd626 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:25.071438 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b2d80a06-c1fd-489c-a05e-f7b2137bd626 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1407 microversion: 2.20 time: 0.153445 May 26 20:32:25.072001 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 457/920] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:24 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:26.089878 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-45ce4190-0988-4dcc-9b8c-586f5e55adf5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:26.090475 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-45ce4190-0988-4dcc-9b8c-586f5e55adf5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:26.097075 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-45ce4190-0988-4dcc-9b8c-586f5e55adf5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:26.097526 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-45ce4190-0988-4dcc-9b8c-586f5e55adf5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:26.098326 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-45ce4190-0988-4dcc-9b8c-586f5e55adf5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:26.098766 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-45ce4190-0988-4dcc-9b8c-586f5e55adf5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:26.232574 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-45ce4190-0988-4dcc-9b8c-586f5e55adf5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:26.240465 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-45ce4190-0988-4dcc-9b8c-586f5e55adf5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:26.242115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-45ce4190-0988-4dcc-9b8c-586f5e55adf5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:26.243247 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-45ce4190-0988-4dcc-9b8c-586f5e55adf5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1407 microversion: 2.20 time: 0.158279 May 26 20:32:26.243801 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 464/921] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:26 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:32:27.261016 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-eec052d4-9c50-4fc8-96b2-fd76db5ea2ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:27.261629 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-eec052d4-9c50-4fc8-96b2-fd76db5ea2ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:27.268168 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eec052d4-9c50-4fc8-96b2-fd76db5ea2ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:27.268622 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eec052d4-9c50-4fc8-96b2-fd76db5ea2ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:27.269390 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eec052d4-9c50-4fc8-96b2-fd76db5ea2ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:27.269832 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-eec052d4-9c50-4fc8-96b2-fd76db5ea2ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:27.398666 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-eec052d4-9c50-4fc8-96b2-fd76db5ea2ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:27.406601 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-eec052d4-9c50-4fc8-96b2-fd76db5ea2ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:27.408089 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-eec052d4-9c50-4fc8-96b2-fd76db5ea2ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:32:27.409247 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-eec052d4-9c50-4fc8-96b2-fd76db5ea2ed tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1599 microversion: 2.20 time: 0.152324 May 26 20:32:27.409811 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 458/922] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:32:27 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:32:27.426919 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-89d796e9-8df0-427d-bc82-c4a1da52130b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:32:27.427426 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-89d796e9-8df0-427d-bc82-c4a1da52130b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:32:27.430536 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:32:27.435227 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-89d796e9-8df0-427d-bc82-c4a1da52130b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:27.435668 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-89d796e9-8df0-427d-bc82-c4a1da52130b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:27.436422 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-89d796e9-8df0-427d-bc82-c4a1da52130b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:27.436851 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-89d796e9-8df0-427d-bc82-c4a1da52130b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:27.512839 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-89d796e9-8df0-427d-bc82-c4a1da52130b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089756 May 26 20:32:27.513438 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 465/923] 10.222.0.44 () {60 vars in 1315 bytes} [Thu May 26 20:32:27 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:32:28.721455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-90217f8d-aaa0-47f8-b4d8-29e79817693c req-b307393b-a739-4574-9f72-488e62e0bd6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e8a714b-7c67-466b-8448-e5a66aa434ee", "tag": "8aa75e2d-2a2c-43bc-809a-e911f84bfa6e"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:32:28.730283 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-90217f8d-aaa0-47f8-b4d8-29e79817693c req-b307393b-a739-4574-9f72-488e62e0bd6f service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:32:28.730729 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-90217f8d-aaa0-47f8-b4d8-29e79817693c req-b307393b-a739-4574-9f72-488e62e0bd6f service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:32:28.744625 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-90217f8d-aaa0-47f8-b4d8-29e79817693c req-b307393b-a739-4574-9f72-488e62e0bd6f service nova] Creating event network-changed:8aa75e2d-2a2c-43bc-809a-e911f84bfa6e for instance 0e8a714b-7c67-466b-8448-e5a66aa434ee on hv-cinder-84213 May 26 20:32:28.750598 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-90217f8d-aaa0-47f8-b4d8-29e79817693c req-b307393b-a739-4574-9f72-488e62e0bd6f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032928 May 26 20:32:28.751289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 459/924] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:33:04.705187 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=57 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:33:04.709581 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ad81e33e-e3c6-40b1-9cbe-8c8d0dbc13c7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:04.710066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ad81e33e-e3c6-40b1-9cbe-8c8d0dbc13c7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:04.716192 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ad81e33e-e3c6-40b1-9cbe-8c8d0dbc13c7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:04.716709 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ad81e33e-e3c6-40b1-9cbe-8c8d0dbc13c7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:04.717583 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ad81e33e-e3c6-40b1-9cbe-8c8d0dbc13c7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:04.718011 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ad81e33e-e3c6-40b1-9cbe-8c8d0dbc13c7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:04.740539 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ad81e33e-e3c6-40b1-9cbe-8c8d0dbc13c7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/ips" status: 200 len: 152 microversion: 2.20 time: 0.036980 May 26 20:33:04.741120 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 466/925] 10.222.0.44 () {60 vars in 1288 bytes} [Thu May 26 20:33:04 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:33:06.836395 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:33:06.837149 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:33:06.841636 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-10d4c4d3-7730-400c-a4a8-d39d2425c49b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:33:06.845297 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-10d4c4d3-7730-400c-a4a8-d39d2425c49b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:06.849007 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-10d4c4d3-7730-400c-a4a8-d39d2425c49b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:06.849457 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-10d4c4d3-7730-400c-a4a8-d39d2425c49b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:06.850222 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-10d4c4d3-7730-400c-a4a8-d39d2425c49b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:06.850705 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-10d4c4d3-7730-400c-a4a8-d39d2425c49b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:06.873262 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-10d4c4d3-7730-400c-a4a8-d39d2425c49b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lazy-loading 'flavor' on Instance uuid 0e8a714b-7c67-466b-8448-e5a66aa434ee {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:33:07.420440 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-10d4c4d3-7730-400c-a4a8-d39d2425c49b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "POST /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/action" status: 202 len: 0 microversion: 2.20 time: 0.585427 May 26 20:33:07.421125 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 460/926] 10.222.0.44 () {62 vars in 1318 bytes} [Thu May 26 20:33:06 2022] POST /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 20:33:07.429106 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-99ef5801-64fa-4604-b613-673350b6b110 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:07.429824 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-99ef5801-64fa-4604-b613-673350b6b110 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:07.437504 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-99ef5801-64fa-4604-b613-673350b6b110 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:07.437964 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-99ef5801-64fa-4604-b613-673350b6b110 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:07.438762 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-99ef5801-64fa-4604-b613-673350b6b110 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:07.439203 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-99ef5801-64fa-4604-b613-673350b6b110 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:07.572154 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-99ef5801-64fa-4604-b613-673350b6b110 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:07.580804 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-99ef5801-64fa-4604-b613-673350b6b110 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:07.582382 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-99ef5801-64fa-4604-b613-673350b6b110 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:07.583623 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-99ef5801-64fa-4604-b613-673350b6b110 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1724 microversion: 2.20 time: 0.158465 May 26 20:33:07.584185 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 467/927] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:07 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:33:08.604153 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-18698573-54ee-482c-a73a-90286c5c76bb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:08.604773 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-18698573-54ee-482c-a73a-90286c5c76bb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:08.611691 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-18698573-54ee-482c-a73a-90286c5c76bb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:08.612145 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-18698573-54ee-482c-a73a-90286c5c76bb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:08.612916 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-18698573-54ee-482c-a73a-90286c5c76bb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:08.613357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-18698573-54ee-482c-a73a-90286c5c76bb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:08.752114 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-18698573-54ee-482c-a73a-90286c5c76bb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:08.760056 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-18698573-54ee-482c-a73a-90286c5c76bb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:08.761567 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-18698573-54ee-482c-a73a-90286c5c76bb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:08.762767 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-18698573-54ee-482c-a73a-90286c5c76bb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1724 microversion: 2.20 time: 0.163570 May 26 20:33:08.763335 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 461/928] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:08 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:09.782097 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-02f5cb34-82bc-49b2-ae2f-f5d5712a8a0f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:09.782740 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-02f5cb34-82bc-49b2-ae2f-f5d5712a8a0f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:09.789275 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-02f5cb34-82bc-49b2-ae2f-f5d5712a8a0f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:09.789722 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-02f5cb34-82bc-49b2-ae2f-f5d5712a8a0f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:09.790515 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-02f5cb34-82bc-49b2-ae2f-f5d5712a8a0f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:09.790950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-02f5cb34-82bc-49b2-ae2f-f5d5712a8a0f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:09.920010 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-02f5cb34-82bc-49b2-ae2f-f5d5712a8a0f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:09.928895 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-02f5cb34-82bc-49b2-ae2f-f5d5712a8a0f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:09.930487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-02f5cb34-82bc-49b2-ae2f-f5d5712a8a0f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:09.931630 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-02f5cb34-82bc-49b2-ae2f-f5d5712a8a0f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1724 microversion: 2.20 time: 0.154191 May 26 20:33:09.932188 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 468/929] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:09 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:10.950096 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-05016383-acce-45d3-a279-0f7c5125a90e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:10.950745 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-05016383-acce-45d3-a279-0f7c5125a90e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:10.957581 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05016383-acce-45d3-a279-0f7c5125a90e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:10.958034 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05016383-acce-45d3-a279-0f7c5125a90e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:10.958843 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05016383-acce-45d3-a279-0f7c5125a90e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:10.959291 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-05016383-acce-45d3-a279-0f7c5125a90e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:11.086327 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-05016383-acce-45d3-a279-0f7c5125a90e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:11.094753 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-05016383-acce-45d3-a279-0f7c5125a90e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:11.096276 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-05016383-acce-45d3-a279-0f7c5125a90e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:11.097441 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-05016383-acce-45d3-a279-0f7c5125a90e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1724 microversion: 2.20 time: 0.151299 May 26 20:33:11.097999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 462/930] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:10 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:12.114751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-715c2f97-4d24-4ea8-a0b8-c02da01c609f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:12.115270 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-715c2f97-4d24-4ea8-a0b8-c02da01c609f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:12.121774 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-715c2f97-4d24-4ea8-a0b8-c02da01c609f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:12.122228 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-715c2f97-4d24-4ea8-a0b8-c02da01c609f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:12.123017 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-715c2f97-4d24-4ea8-a0b8-c02da01c609f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:12.123455 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-715c2f97-4d24-4ea8-a0b8-c02da01c609f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:12.250188 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-715c2f97-4d24-4ea8-a0b8-c02da01c609f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:12.258116 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-715c2f97-4d24-4ea8-a0b8-c02da01c609f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:12.259655 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-715c2f97-4d24-4ea8-a0b8-c02da01c609f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:12.260813 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-715c2f97-4d24-4ea8-a0b8-c02da01c609f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1724 microversion: 2.20 time: 0.150038 May 26 20:33:12.261372 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 469/931] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:12 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:13.279819 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7f2059bf-1fc1-40c4-8eaa-c08367591122 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:13.281278 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7f2059bf-1fc1-40c4-8eaa-c08367591122 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:13.287294 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f2059bf-1fc1-40c4-8eaa-c08367591122 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:13.287752 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f2059bf-1fc1-40c4-8eaa-c08367591122 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:13.288522 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f2059bf-1fc1-40c4-8eaa-c08367591122 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:13.288964 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7f2059bf-1fc1-40c4-8eaa-c08367591122 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:13.413870 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7f2059bf-1fc1-40c4-8eaa-c08367591122 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:13.421729 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7f2059bf-1fc1-40c4-8eaa-c08367591122 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:13.423267 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7f2059bf-1fc1-40c4-8eaa-c08367591122 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:13.424433 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7f2059bf-1fc1-40c4-8eaa-c08367591122 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1724 microversion: 2.20 time: 0.148672 May 26 20:33:13.425001 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 463/932] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:13 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:14.442640 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5e92ed30-10c1-40b1-83fb-3136e1908fbc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:14.443188 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5e92ed30-10c1-40b1-83fb-3136e1908fbc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:14.449657 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5e92ed30-10c1-40b1-83fb-3136e1908fbc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:14.450108 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5e92ed30-10c1-40b1-83fb-3136e1908fbc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:14.450905 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5e92ed30-10c1-40b1-83fb-3136e1908fbc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:14.451349 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5e92ed30-10c1-40b1-83fb-3136e1908fbc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:14.581128 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5e92ed30-10c1-40b1-83fb-3136e1908fbc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:14.589202 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5e92ed30-10c1-40b1-83fb-3136e1908fbc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:14.590741 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5e92ed30-10c1-40b1-83fb-3136e1908fbc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:14.591897 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5e92ed30-10c1-40b1-83fb-3136e1908fbc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1724 microversion: 2.20 time: 0.153333 May 26 20:33:14.592461 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 470/933] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:14 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:15.611626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-24b78cfa-4ac9-4f28-99aa-467d5fe973f6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:15.612171 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-24b78cfa-4ac9-4f28-99aa-467d5fe973f6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:15.618691 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-24b78cfa-4ac9-4f28-99aa-467d5fe973f6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:15.619142 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-24b78cfa-4ac9-4f28-99aa-467d5fe973f6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:15.619909 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-24b78cfa-4ac9-4f28-99aa-467d5fe973f6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:15.620340 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-24b78cfa-4ac9-4f28-99aa-467d5fe973f6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:15.751182 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-24b78cfa-4ac9-4f28-99aa-467d5fe973f6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:15.759287 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-24b78cfa-4ac9-4f28-99aa-467d5fe973f6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:15.764846 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-24b78cfa-4ac9-4f28-99aa-467d5fe973f6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:15.764846 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-24b78cfa-4ac9-4f28-99aa-467d5fe973f6 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1724 microversion: 2.20 time: 0.154989 May 26 20:33:15.764846 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 464/934] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:15 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:16.780607 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9b93817c-87e9-4fd3-9a52-ed53ae55a922 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:16.781214 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9b93817c-87e9-4fd3-9a52-ed53ae55a922 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:16.788187 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9b93817c-87e9-4fd3-9a52-ed53ae55a922 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:16.788632 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9b93817c-87e9-4fd3-9a52-ed53ae55a922 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:16.789413 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9b93817c-87e9-4fd3-9a52-ed53ae55a922 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:16.789841 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9b93817c-87e9-4fd3-9a52-ed53ae55a922 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:16.920126 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9b93817c-87e9-4fd3-9a52-ed53ae55a922 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:16.928206 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9b93817c-87e9-4fd3-9a52-ed53ae55a922 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:16.929705 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9b93817c-87e9-4fd3-9a52-ed53ae55a922 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:16.930898 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9b93817c-87e9-4fd3-9a52-ed53ae55a922 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1724 microversion: 2.20 time: 0.154248 May 26 20:33:16.931462 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 471/935] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:16 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:17.949306 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-e6c5da21-7f61-4e4e-b15b-ee3411e6b04b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:17.949943 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-e6c5da21-7f61-4e4e-b15b-ee3411e6b04b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:17.957299 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6c5da21-7f61-4e4e-b15b-ee3411e6b04b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:17.957758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6c5da21-7f61-4e4e-b15b-ee3411e6b04b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:17.958565 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6c5da21-7f61-4e4e-b15b-ee3411e6b04b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:17.959012 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-e6c5da21-7f61-4e4e-b15b-ee3411e6b04b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:18.092059 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e6c5da21-7f61-4e4e-b15b-ee3411e6b04b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:18.100884 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e6c5da21-7f61-4e4e-b15b-ee3411e6b04b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:18.102456 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-e6c5da21-7f61-4e4e-b15b-ee3411e6b04b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:18.103760 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-e6c5da21-7f61-4e4e-b15b-ee3411e6b04b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1745 microversion: 2.20 time: 0.158362 May 26 20:33:18.104319 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 465/936] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:17 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:19.122297 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-cf21d4c3-1528-4084-a43c-cb4bbe06f1bd tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:19.122915 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-cf21d4c3-1528-4084-a43c-cb4bbe06f1bd tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:19.129510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cf21d4c3-1528-4084-a43c-cb4bbe06f1bd tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:19.129957 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cf21d4c3-1528-4084-a43c-cb4bbe06f1bd tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:19.130755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cf21d4c3-1528-4084-a43c-cb4bbe06f1bd tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:19.131194 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-cf21d4c3-1528-4084-a43c-cb4bbe06f1bd tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:19.261196 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cf21d4c3-1528-4084-a43c-cb4bbe06f1bd tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:19.269503 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cf21d4c3-1528-4084-a43c-cb4bbe06f1bd tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:19.271041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-cf21d4c3-1528-4084-a43c-cb4bbe06f1bd tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:19.272202 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-cf21d4c3-1528-4084-a43c-cb4bbe06f1bd tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1745 microversion: 2.20 time: 0.153879 May 26 20:33:19.272753 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 472/937] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:19 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:20.290227 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ed781b36-66dd-438e-be4c-ac13d53e54cc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:20.292403 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ed781b36-66dd-438e-be4c-ac13d53e54cc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:20.298355 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed781b36-66dd-438e-be4c-ac13d53e54cc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:20.298812 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed781b36-66dd-438e-be4c-ac13d53e54cc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:20.300263 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed781b36-66dd-438e-be4c-ac13d53e54cc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:20.300960 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ed781b36-66dd-438e-be4c-ac13d53e54cc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:20.434978 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ed781b36-66dd-438e-be4c-ac13d53e54cc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:20.444419 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ed781b36-66dd-438e-be4c-ac13d53e54cc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:20.445991 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ed781b36-66dd-438e-be4c-ac13d53e54cc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:20.447257 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ed781b36-66dd-438e-be4c-ac13d53e54cc tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1740 microversion: 2.20 time: 0.160900 May 26 20:33:20.448054 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 466/938] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:20 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:21.474723 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-de0dfed8-c2b2-4601-a75d-3f679856476b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:21.475456 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-de0dfed8-c2b2-4601-a75d-3f679856476b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:21.482073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-de0dfed8-c2b2-4601-a75d-3f679856476b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:21.482756 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-de0dfed8-c2b2-4601-a75d-3f679856476b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:21.483526 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-de0dfed8-c2b2-4601-a75d-3f679856476b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:21.483958 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-de0dfed8-c2b2-4601-a75d-3f679856476b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:21.627521 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-de0dfed8-c2b2-4601-a75d-3f679856476b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:21.639028 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-de0dfed8-c2b2-4601-a75d-3f679856476b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:21.640522 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-de0dfed8-c2b2-4601-a75d-3f679856476b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:21.641678 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-de0dfed8-c2b2-4601-a75d-3f679856476b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1740 microversion: 2.20 time: 0.171669 May 26 20:33:21.643381 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 473/939] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:21 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:22.473947 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-bf29c91d-3b4b-4e66-b727-4555c2fd9888 req-e2997937-d759-434f-99b9-d901c2e0a759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a714b-7c67-466b-8448-e5a66aa434ee", "name": "network-vif-plugged", "status": "completed", "tag": "8aa75e2d-2a2c-43bc-809a-e911f84bfa6e"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:33:22.486956 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-bf29c91d-3b4b-4e66-b727-4555c2fd9888 req-e2997937-d759-434f-99b9-d901c2e0a759 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:22.487391 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-bf29c91d-3b4b-4e66-b727-4555c2fd9888 req-e2997937-d759-434f-99b9-d901c2e0a759 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:22.499603 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-bf29c91d-3b4b-4e66-b727-4555c2fd9888 req-e2997937-d759-434f-99b9-d901c2e0a759 service nova] Creating event network-vif-plugged:8aa75e2d-2a2c-43bc-809a-e911f84bfa6e for instance 0e8a714b-7c67-466b-8448-e5a66aa434ee on hv-cinder-84213 May 26 20:33:22.505406 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-bf29c91d-3b4b-4e66-b727-4555c2fd9888 req-e2997937-d759-434f-99b9-d901c2e0a759 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037508 May 26 20:33:22.506442 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 467/940] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:33:22.661013 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-91acaa7a-0a70-4ea0-9839-5ffeae15f97e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:22.661637 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-91acaa7a-0a70-4ea0-9839-5ffeae15f97e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:22.669111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-91acaa7a-0a70-4ea0-9839-5ffeae15f97e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:22.669881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-91acaa7a-0a70-4ea0-9839-5ffeae15f97e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:22.670758 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-91acaa7a-0a70-4ea0-9839-5ffeae15f97e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:22.671489 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-91acaa7a-0a70-4ea0-9839-5ffeae15f97e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:22.813374 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-91acaa7a-0a70-4ea0-9839-5ffeae15f97e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:22.824499 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-91acaa7a-0a70-4ea0-9839-5ffeae15f97e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:22.825991 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-91acaa7a-0a70-4ea0-9839-5ffeae15f97e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:22.827173 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-91acaa7a-0a70-4ea0-9839-5ffeae15f97e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1740 microversion: 2.20 time: 0.171138 May 26 20:33:22.828084 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 474/941] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:22 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:23.849911 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-01c743ea-fae2-412b-ab43-0d3c4d223600 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:23.851272 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-01c743ea-fae2-412b-ab43-0d3c4d223600 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:23.858608 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01c743ea-fae2-412b-ab43-0d3c4d223600 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:23.859432 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01c743ea-fae2-412b-ab43-0d3c4d223600 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:23.860444 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01c743ea-fae2-412b-ab43-0d3c4d223600 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:23.861088 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-01c743ea-fae2-412b-ab43-0d3c4d223600 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:24.021869 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-01c743ea-fae2-412b-ab43-0d3c4d223600 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:24.031702 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-01c743ea-fae2-412b-ab43-0d3c4d223600 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:24.033491 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-01c743ea-fae2-412b-ab43-0d3c4d223600 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:24.035593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-01c743ea-fae2-412b-ab43-0d3c4d223600 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1740 microversion: 2.20 time: 0.190753 May 26 20:33:24.046176 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 468/942] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:23 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:25.054819 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-61237663-5908-4caf-ab7b-4af437fdb7af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:25.055412 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-61237663-5908-4caf-ab7b-4af437fdb7af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:25.062426 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61237663-5908-4caf-ab7b-4af437fdb7af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:25.062879 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61237663-5908-4caf-ab7b-4af437fdb7af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:25.063641 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61237663-5908-4caf-ab7b-4af437fdb7af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:25.064075 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61237663-5908-4caf-ab7b-4af437fdb7af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:25.214530 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-61237663-5908-4caf-ab7b-4af437fdb7af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:25.225781 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-61237663-5908-4caf-ab7b-4af437fdb7af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:25.227299 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-61237663-5908-4caf-ab7b-4af437fdb7af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:25.228467 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-61237663-5908-4caf-ab7b-4af437fdb7af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1740 microversion: 2.20 time: 0.179353 May 26 20:33:25.229299 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 475/943] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:25 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:26.249689 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-35ccf3bf-018b-44fa-a0e5-0422927c408f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:26.250441 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-35ccf3bf-018b-44fa-a0e5-0422927c408f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:26.258169 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-35ccf3bf-018b-44fa-a0e5-0422927c408f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:26.258710 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-35ccf3bf-018b-44fa-a0e5-0422927c408f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:26.259635 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-35ccf3bf-018b-44fa-a0e5-0422927c408f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:26.260273 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-35ccf3bf-018b-44fa-a0e5-0422927c408f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:26.417357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-35ccf3bf-018b-44fa-a0e5-0422927c408f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:26.426004 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-35ccf3bf-018b-44fa-a0e5-0422927c408f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:26.442825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-35ccf3bf-018b-44fa-a0e5-0422927c408f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:26.442825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-35ccf3bf-018b-44fa-a0e5-0422927c408f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1740 microversion: 2.20 time: 0.183580 May 26 20:33:26.442825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 469/944] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:26 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:27.447784 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-223123ad-c3df-412a-98d7-228cf4e6a727 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:27.448494 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-223123ad-c3df-412a-98d7-228cf4e6a727 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:27.455263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-223123ad-c3df-412a-98d7-228cf4e6a727 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:27.455960 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-223123ad-c3df-412a-98d7-228cf4e6a727 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:27.457094 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-223123ad-c3df-412a-98d7-228cf4e6a727 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:27.459272 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-223123ad-c3df-412a-98d7-228cf4e6a727 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:27.608467 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-223123ad-c3df-412a-98d7-228cf4e6a727 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:27.617138 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-223123ad-c3df-412a-98d7-228cf4e6a727 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:27.618677 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-223123ad-c3df-412a-98d7-228cf4e6a727 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:27.619850 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-223123ad-c3df-412a-98d7-228cf4e6a727 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1740 microversion: 2.20 time: 0.176043 May 26 20:33:27.620423 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 476/945] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:27 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:28.637455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c210b444-b994-44ff-a83e-c41c441d95f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:28.638020 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c210b444-b994-44ff-a83e-c41c441d95f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:28.650841 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c210b444-b994-44ff-a83e-c41c441d95f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:28.651305 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c210b444-b994-44ff-a83e-c41c441d95f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:28.652098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c210b444-b994-44ff-a83e-c41c441d95f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:28.652537 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c210b444-b994-44ff-a83e-c41c441d95f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:28.808086 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c210b444-b994-44ff-a83e-c41c441d95f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:28.817388 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c210b444-b994-44ff-a83e-c41c441d95f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:28.820281 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c210b444-b994-44ff-a83e-c41c441d95f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:28.821501 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c210b444-b994-44ff-a83e-c41c441d95f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1740 microversion: 2.20 time: 0.188070 May 26 20:33:28.822276 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 470/946] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:28 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:29.839557 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-12fa8597-b10c-409d-9c22-373348567eb9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:29.840171 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-12fa8597-b10c-409d-9c22-373348567eb9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:29.847707 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12fa8597-b10c-409d-9c22-373348567eb9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:29.848370 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12fa8597-b10c-409d-9c22-373348567eb9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:29.849188 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12fa8597-b10c-409d-9c22-373348567eb9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:29.849875 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-12fa8597-b10c-409d-9c22-373348567eb9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:29.999774 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-12fa8597-b10c-409d-9c22-373348567eb9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:30.015194 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-12fa8597-b10c-409d-9c22-373348567eb9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:30.016700 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-12fa8597-b10c-409d-9c22-373348567eb9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:30.018423 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-12fa8597-b10c-409d-9c22-373348567eb9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1740 microversion: 2.20 time: 0.182955 May 26 20:33:30.019568 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 477/947] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:29 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:31.037928 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-43c3d203-e188-41b4-a105-1de1b154ca8c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:31.038571 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-43c3d203-e188-41b4-a105-1de1b154ca8c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:31.045139 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43c3d203-e188-41b4-a105-1de1b154ca8c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:31.045589 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43c3d203-e188-41b4-a105-1de1b154ca8c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:31.046392 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43c3d203-e188-41b4-a105-1de1b154ca8c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:31.046911 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-43c3d203-e188-41b4-a105-1de1b154ca8c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:31.410992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-43c3d203-e188-41b4-a105-1de1b154ca8c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:31.419071 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-43c3d203-e188-41b4-a105-1de1b154ca8c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:31.420669 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-43c3d203-e188-41b4-a105-1de1b154ca8c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:31.421834 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-43c3d203-e188-41b4-a105-1de1b154ca8c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1740 microversion: 2.20 time: 0.388490 May 26 20:33:31.422430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 471/948] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:31 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1740 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:32.440351 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7f56d592-794f-41ee-b27c-5a1b13b165d3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:32.440961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7f56d592-794f-41ee-b27c-5a1b13b165d3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:32.448371 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7f56d592-794f-41ee-b27c-5a1b13b165d3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:32.448821 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7f56d592-794f-41ee-b27c-5a1b13b165d3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:32.449591 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7f56d592-794f-41ee-b27c-5a1b13b165d3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:32.450031 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7f56d592-794f-41ee-b27c-5a1b13b165d3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:32.633135 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7f56d592-794f-41ee-b27c-5a1b13b165d3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:32.641123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7f56d592-794f-41ee-b27c-5a1b13b165d3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:32.642670 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-7f56d592-794f-41ee-b27c-5a1b13b165d3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:32.643811 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7f56d592-794f-41ee-b27c-5a1b13b165d3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1722 microversion: 2.20 time: 0.207417 May 26 20:33:32.644368 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 478/949] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:32 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:33.662468 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cb1c7d6c-9e29-4d68-baa9-afd0dbb2eacf tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:33.663113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cb1c7d6c-9e29-4d68-baa9-afd0dbb2eacf tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:33.669739 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb1c7d6c-9e29-4d68-baa9-afd0dbb2eacf tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:33.670192 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb1c7d6c-9e29-4d68-baa9-afd0dbb2eacf tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:33.671071 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb1c7d6c-9e29-4d68-baa9-afd0dbb2eacf tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:33.671540 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cb1c7d6c-9e29-4d68-baa9-afd0dbb2eacf tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:33.809937 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cb1c7d6c-9e29-4d68-baa9-afd0dbb2eacf tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:33.818651 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cb1c7d6c-9e29-4d68-baa9-afd0dbb2eacf tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:33.820180 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cb1c7d6c-9e29-4d68-baa9-afd0dbb2eacf tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:33.821336 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cb1c7d6c-9e29-4d68-baa9-afd0dbb2eacf tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1722 microversion: 2.20 time: 0.162996 May 26 20:33:33.821959 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 472/950] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:33 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:34.483202 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-26bd54c6-b030-4d7e-a92a-9f637a29a792 req-a361f67e-43ef-4e88-8494-83c3a60bd485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a714b-7c67-466b-8448-e5a66aa434ee", "name": "network-vif-unplugged", "status": "completed", "tag": "8aa75e2d-2a2c-43bc-809a-e911f84bfa6e"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:33:34.491704 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-26bd54c6-b030-4d7e-a92a-9f637a29a792 req-a361f67e-43ef-4e88-8494-83c3a60bd485 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:34.492155 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-26bd54c6-b030-4d7e-a92a-9f637a29a792 req-a361f67e-43ef-4e88-8494-83c3a60bd485 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:34.503073 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.compute.server_external_events [req-26bd54c6-b030-4d7e-a92a-9f637a29a792 req-a361f67e-43ef-4e88-8494-83c3a60bd485 service nova] Unable to find a host for instance 0e8a714b-7c67-466b-8448-e5a66aa434ee. Dropping event network-vif-unplugged {{(pid=118306) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 20:33:34.509088 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-26bd54c6-b030-4d7e-a92a-9f637a29a792 req-a361f67e-43ef-4e88-8494-83c3a60bd485 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024661 May 26 20:33:34.509088 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 479/951] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 20:33:34.840171 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-32b11c22-9d8d-4e57-ad2c-aa9c183be3e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:34.840721 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-32b11c22-9d8d-4e57-ad2c-aa9c183be3e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:34.847174 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-32b11c22-9d8d-4e57-ad2c-aa9c183be3e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:34.847620 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-32b11c22-9d8d-4e57-ad2c-aa9c183be3e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:34.848518 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-32b11c22-9d8d-4e57-ad2c-aa9c183be3e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:34.848952 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-32b11c22-9d8d-4e57-ad2c-aa9c183be3e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:34.975436 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-32b11c22-9d8d-4e57-ad2c-aa9c183be3e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:34.983220 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-32b11c22-9d8d-4e57-ad2c-aa9c183be3e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:34.984703 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-32b11c22-9d8d-4e57-ad2c-aa9c183be3e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:34.985838 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-32b11c22-9d8d-4e57-ad2c-aa9c183be3e1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1665 microversion: 2.20 time: 0.149993 May 26 20:33:34.986426 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 473/952] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:34 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:35.003784 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-3b03c63e-392f-4b79-8302-f5ed804df116 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1838d5f-0914-4eff-8690-9cf885c9e8c3"}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:33:35.005826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-3b03c63e-392f-4b79-8302-f5ed804df116 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:35.007712 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=30 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:33:35.012417 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3b03c63e-392f-4b79-8302-f5ed804df116 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:35.012867 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3b03c63e-392f-4b79-8302-f5ed804df116 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:35.013657 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3b03c63e-392f-4b79-8302-f5ed804df116 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:35.014092 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-3b03c63e-392f-4b79-8302-f5ed804df116 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:35.917079 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:33:36.009451 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-3b03c63e-392f-4b79-8302-f5ed804df116 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "POST /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.009582 May 26 20:33:36.010017 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 480/953] 10.222.0.44 () {62 vars in 1363 bytes} [Thu May 26 20:33:34 2022] POST /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/os-volume_attachments => generated 188 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 20:33:36.126454 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-784afecf-a75e-491d-962a-fb494edd0dcb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:36.126955 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-784afecf-a75e-491d-962a-fb494edd0dcb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:36.133855 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-784afecf-a75e-491d-962a-fb494edd0dcb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:36.134351 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-784afecf-a75e-491d-962a-fb494edd0dcb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:36.135119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-784afecf-a75e-491d-962a-fb494edd0dcb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:36.135554 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-784afecf-a75e-491d-962a-fb494edd0dcb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:36.219399 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:33:36.689344 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-784afecf-a75e-491d-962a-fb494edd0dcb tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/os-volume_attachments/c1838d5f-0914-4eff-8690-9cf885c9e8c3" status: 202 len: 0 microversion: 2.20 time: 0.566820 May 26 20:33:36.689941 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 474/954] 10.222.0.44 () {60 vars in 1456 bytes} [Thu May 26 20:33:36 2022] DELETE /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/os-volume_attachments/c1838d5f-0914-4eff-8690-9cf885c9e8c3 => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 20:33:36.748979 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9dcb9735-2cc3-4699-bd96-96dda80eca2b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:33:36.749685 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9dcb9735-2cc3-4699-bd96-96dda80eca2b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:36.757927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9dcb9735-2cc3-4699-bd96-96dda80eca2b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:36.766661 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9dcb9735-2cc3-4699-bd96-96dda80eca2b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:36.766661 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9dcb9735-2cc3-4699-bd96-96dda80eca2b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:36.766661 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9dcb9735-2cc3-4699-bd96-96dda80eca2b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:36.995708 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9dcb9735-2cc3-4699-bd96-96dda80eca2b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "POST /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/action" status: 202 len: 0 microversion: 2.20 time: 0.250750 May 26 20:33:36.996542 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 481/955] 10.222.0.44 () {62 vars in 1318 bytes} [Thu May 26 20:33:36 2022] POST /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 20:33:37.004617 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cba33ac6-436d-4977-ab5c-f6dd5ec76db5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:37.005266 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cba33ac6-436d-4977-ab5c-f6dd5ec76db5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:37.011387 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cba33ac6-436d-4977-ab5c-f6dd5ec76db5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:37.011848 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cba33ac6-436d-4977-ab5c-f6dd5ec76db5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:37.012625 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cba33ac6-436d-4977-ab5c-f6dd5ec76db5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:37.013068 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cba33ac6-436d-4977-ab5c-f6dd5ec76db5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:37.144952 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cba33ac6-436d-4977-ab5c-f6dd5ec76db5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:37.153355 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cba33ac6-436d-4977-ab5c-f6dd5ec76db5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:37.154892 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cba33ac6-436d-4977-ab5c-f6dd5ec76db5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:37.156051 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cba33ac6-436d-4977-ab5c-f6dd5ec76db5 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1673 microversion: 2.20 time: 0.155644 May 26 20:33:37.156616 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 475/956] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:36 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:38.175404 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8852c427-6aa0-483e-8fed-dcfcfe996dc3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:38.175968 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8852c427-6aa0-483e-8fed-dcfcfe996dc3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:38.183937 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8852c427-6aa0-483e-8fed-dcfcfe996dc3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:38.184398 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8852c427-6aa0-483e-8fed-dcfcfe996dc3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:38.185149 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8852c427-6aa0-483e-8fed-dcfcfe996dc3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:38.185591 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8852c427-6aa0-483e-8fed-dcfcfe996dc3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:38.316907 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8852c427-6aa0-483e-8fed-dcfcfe996dc3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:38.325541 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8852c427-6aa0-483e-8fed-dcfcfe996dc3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:38.327096 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8852c427-6aa0-483e-8fed-dcfcfe996dc3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:38.328235 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8852c427-6aa0-483e-8fed-dcfcfe996dc3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1675 microversion: 2.20 time: 0.156901 May 26 20:33:38.332600 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 482/957] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:38 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:39.346986 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-280045b4-6406-4439-b511-a1f451e26a3c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:39.347684 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-280045b4-6406-4439-b511-a1f451e26a3c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:39.350467 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=33 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:33:39.355281 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-280045b4-6406-4439-b511-a1f451e26a3c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:39.355737 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-280045b4-6406-4439-b511-a1f451e26a3c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:39.356628 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-280045b4-6406-4439-b511-a1f451e26a3c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:39.357080 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-280045b4-6406-4439-b511-a1f451e26a3c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:39.507715 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-280045b4-6406-4439-b511-a1f451e26a3c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:39.515882 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-280045b4-6406-4439-b511-a1f451e26a3c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:39.517892 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-280045b4-6406-4439-b511-a1f451e26a3c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:39.518544 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-280045b4-6406-4439-b511-a1f451e26a3c tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.175528 May 26 20:33:39.519116 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 476/958] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:39 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:40.537888 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-09a9be4b-bbaa-4d6b-8398-9f7f958dd2f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:40.538487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-09a9be4b-bbaa-4d6b-8398-9f7f958dd2f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:40.545052 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-09a9be4b-bbaa-4d6b-8398-9f7f958dd2f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:40.545546 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-09a9be4b-bbaa-4d6b-8398-9f7f958dd2f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:40.546463 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-09a9be4b-bbaa-4d6b-8398-9f7f958dd2f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:40.546925 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-09a9be4b-bbaa-4d6b-8398-9f7f958dd2f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:40.694746 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-09a9be4b-bbaa-4d6b-8398-9f7f958dd2f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:40.703411 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-09a9be4b-bbaa-4d6b-8398-9f7f958dd2f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:40.704976 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-09a9be4b-bbaa-4d6b-8398-9f7f958dd2f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:40.706451 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-09a9be4b-bbaa-4d6b-8398-9f7f958dd2f4 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.172999 May 26 20:33:40.715610 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 483/959] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:40 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:41.726076 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9d1461d3-127c-4ebe-97ab-6bd0cd5c519f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:41.726734 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9d1461d3-127c-4ebe-97ab-6bd0cd5c519f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:41.733110 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9d1461d3-127c-4ebe-97ab-6bd0cd5c519f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:41.733570 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9d1461d3-127c-4ebe-97ab-6bd0cd5c519f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:41.734378 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9d1461d3-127c-4ebe-97ab-6bd0cd5c519f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:41.734851 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9d1461d3-127c-4ebe-97ab-6bd0cd5c519f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:41.896610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9d1461d3-127c-4ebe-97ab-6bd0cd5c519f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:41.908363 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9d1461d3-127c-4ebe-97ab-6bd0cd5c519f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:41.910196 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9d1461d3-127c-4ebe-97ab-6bd0cd5c519f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:41.911741 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9d1461d3-127c-4ebe-97ab-6bd0cd5c519f tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.190399 May 26 20:33:41.912754 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 477/960] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:41 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:42.931039 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9c092ec3-4c5e-4686-99ca-eaa9bdf4e07a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:42.931732 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9c092ec3-4c5e-4686-99ca-eaa9bdf4e07a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:42.939861 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9c092ec3-4c5e-4686-99ca-eaa9bdf4e07a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:42.940310 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9c092ec3-4c5e-4686-99ca-eaa9bdf4e07a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:42.941360 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9c092ec3-4c5e-4686-99ca-eaa9bdf4e07a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:42.941854 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9c092ec3-4c5e-4686-99ca-eaa9bdf4e07a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:43.132108 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9c092ec3-4c5e-4686-99ca-eaa9bdf4e07a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:43.141950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9c092ec3-4c5e-4686-99ca-eaa9bdf4e07a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:43.143482 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9c092ec3-4c5e-4686-99ca-eaa9bdf4e07a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:43.144738 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9c092ec3-4c5e-4686-99ca-eaa9bdf4e07a tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.218122 May 26 20:33:43.145402 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 484/961] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:42 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:44.164692 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-80901b12-1222-48cd-9a7c-f87d21d4b640 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:44.165308 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-80901b12-1222-48cd-9a7c-f87d21d4b640 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:44.174438 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80901b12-1222-48cd-9a7c-f87d21d4b640 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:44.174965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80901b12-1222-48cd-9a7c-f87d21d4b640 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:44.175840 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80901b12-1222-48cd-9a7c-f87d21d4b640 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:44.176364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-80901b12-1222-48cd-9a7c-f87d21d4b640 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:44.322002 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-80901b12-1222-48cd-9a7c-f87d21d4b640 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:44.331059 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-80901b12-1222-48cd-9a7c-f87d21d4b640 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:44.332656 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-80901b12-1222-48cd-9a7c-f87d21d4b640 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:44.334530 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-80901b12-1222-48cd-9a7c-f87d21d4b640 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.174817 May 26 20:33:44.335364 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 478/962] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:44 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:45.353965 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0173b8cc-6f90-4687-bcb4-3f98e8aa7f6b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:45.354666 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0173b8cc-6f90-4687-bcb4-3f98e8aa7f6b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:45.362583 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0173b8cc-6f90-4687-bcb4-3f98e8aa7f6b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:45.363005 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0173b8cc-6f90-4687-bcb4-3f98e8aa7f6b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:45.363783 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0173b8cc-6f90-4687-bcb4-3f98e8aa7f6b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:45.364218 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0173b8cc-6f90-4687-bcb4-3f98e8aa7f6b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:45.509721 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-0173b8cc-6f90-4687-bcb4-3f98e8aa7f6b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:45.517848 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-0173b8cc-6f90-4687-bcb4-3f98e8aa7f6b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:45.519376 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-0173b8cc-6f90-4687-bcb4-3f98e8aa7f6b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:45.520549 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0173b8cc-6f90-4687-bcb4-3f98e8aa7f6b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.171201 May 26 20:33:45.521961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 485/963] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:45 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:45.635917 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:33:45.636463 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Thu May 26 20:33:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:33:46.538921 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fca8dde1-288a-4183-ab34-ed3b3f7c1905 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:46.539464 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fca8dde1-288a-4183-ab34-ed3b3f7c1905 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:46.547477 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fca8dde1-288a-4183-ab34-ed3b3f7c1905 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:46.547948 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fca8dde1-288a-4183-ab34-ed3b3f7c1905 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:46.548733 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fca8dde1-288a-4183-ab34-ed3b3f7c1905 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:46.549182 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fca8dde1-288a-4183-ab34-ed3b3f7c1905 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:46.683979 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-fca8dde1-288a-4183-ab34-ed3b3f7c1905 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:46.692002 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-fca8dde1-288a-4183-ab34-ed3b3f7c1905 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:46.693996 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-fca8dde1-288a-4183-ab34-ed3b3f7c1905 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:46.695464 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fca8dde1-288a-4183-ab34-ed3b3f7c1905 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.160827 May 26 20:33:46.696008 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 479/964] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:46 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:47.713311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c5a132e8-f2c7-423c-9c84-f1665b32f477 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:47.713921 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c5a132e8-f2c7-423c-9c84-f1665b32f477 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:47.720422 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c5a132e8-f2c7-423c-9c84-f1665b32f477 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:47.720867 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c5a132e8-f2c7-423c-9c84-f1665b32f477 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:47.721620 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c5a132e8-f2c7-423c-9c84-f1665b32f477 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:47.722053 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c5a132e8-f2c7-423c-9c84-f1665b32f477 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:47.859052 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c5a132e8-f2c7-423c-9c84-f1665b32f477 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:47.871277 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c5a132e8-f2c7-423c-9c84-f1665b32f477 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:47.872789 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c5a132e8-f2c7-423c-9c84-f1665b32f477 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:47.873965 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c5a132e8-f2c7-423c-9c84-f1665b32f477 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.164896 May 26 20:33:47.874555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 486/965] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:47 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:48.893564 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f287ddc6-8203-4e10-a934-c4ede1f5ba26 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:48.894126 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f287ddc6-8203-4e10-a934-c4ede1f5ba26 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:48.900595 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f287ddc6-8203-4e10-a934-c4ede1f5ba26 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:48.901039 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f287ddc6-8203-4e10-a934-c4ede1f5ba26 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:48.901805 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f287ddc6-8203-4e10-a934-c4ede1f5ba26 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:48.902236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f287ddc6-8203-4e10-a934-c4ede1f5ba26 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:49.040807 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f287ddc6-8203-4e10-a934-c4ede1f5ba26 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:49.048753 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f287ddc6-8203-4e10-a934-c4ede1f5ba26 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:49.050296 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f287ddc6-8203-4e10-a934-c4ede1f5ba26 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:49.051445 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f287ddc6-8203-4e10-a934-c4ede1f5ba26 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.161894 May 26 20:33:49.051998 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 480/966] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:48 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:50.070311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-db3c2619-b6aa-41f9-bc84-8fb1e3c5e3af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:50.070931 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-db3c2619-b6aa-41f9-bc84-8fb1e3c5e3af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:50.077657 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-db3c2619-b6aa-41f9-bc84-8fb1e3c5e3af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:50.078106 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-db3c2619-b6aa-41f9-bc84-8fb1e3c5e3af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:50.080659 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-db3c2619-b6aa-41f9-bc84-8fb1e3c5e3af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:50.080659 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-db3c2619-b6aa-41f9-bc84-8fb1e3c5e3af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:50.207309 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-db3c2619-b6aa-41f9-bc84-8fb1e3c5e3af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:50.215482 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-db3c2619-b6aa-41f9-bc84-8fb1e3c5e3af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:50.217035 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-db3c2619-b6aa-41f9-bc84-8fb1e3c5e3af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:50.218180 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-db3c2619-b6aa-41f9-bc84-8fb1e3c5e3af tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.152560 May 26 20:33:50.218751 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 487/967] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:50 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:51.236338 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-cc0b55f4-fe47-4a98-8a33-efe9025dd7a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:51.236939 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-cc0b55f4-fe47-4a98-8a33-efe9025dd7a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:51.244235 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cc0b55f4-fe47-4a98-8a33-efe9025dd7a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:51.244670 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cc0b55f4-fe47-4a98-8a33-efe9025dd7a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:51.245432 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cc0b55f4-fe47-4a98-8a33-efe9025dd7a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:51.245868 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-cc0b55f4-fe47-4a98-8a33-efe9025dd7a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:51.382721 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cc0b55f4-fe47-4a98-8a33-efe9025dd7a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:51.390941 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cc0b55f4-fe47-4a98-8a33-efe9025dd7a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:51.392432 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-cc0b55f4-fe47-4a98-8a33-efe9025dd7a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:51.393581 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-cc0b55f4-fe47-4a98-8a33-efe9025dd7a3 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.161295 May 26 20:33:51.394135 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 481/968] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:51 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:51.743643 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1836998804", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1889197979", "security_groups": [{"name": "tempest-secgroup-smoke-1530768605"}], "block_device_mapping_v2": [{"uuid": "e7eef001-aa90-4d2b-b1d3-cbfca4f9d854", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48289956-58c4-46df-a124-8d17ca1f3535"}]}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:33:51.867059 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.network.neutron [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] validate_networks() for [('48289956-58c4-46df-a124-8d17ca1f3535', None, None, None, None, None)] {{(pid=118306) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:33:52.257919 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Flavor limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:33:52.258363 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Image limits 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:33:52.262740 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Flavor pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:33:52.262740 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Image pref 0:0:0 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:33:52.262740 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.virt.hardware [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:33:52.268609 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:52.269058 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:52.269875 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:52.270341 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:52.287359 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Getting quotas for project 772b1948bd9546669688fe60a8c9ba46. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:33:52.292632 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Getting quotas for user 9558a9c3df27494d990d3b19f560b4d1 and project 772b1948bd9546669688fe60a8c9ba46. Resources: {'instances', 'ram', 'cores'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:33:52.349786 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Going to run 1 instances... {{(pid=118306) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:33:52.352903 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7eef001-aa90-4d2b-b1d3-cbfca4f9d854',volume_size=None,volume_type=None)] {{(pid=118306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:33:52.412444 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-88b2becc-6cca-4639-82cb-c366db9cac06 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:52.413768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-88b2becc-6cca-4639-82cb-c366db9cac06 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:52.420341 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88b2becc-6cca-4639-82cb-c366db9cac06 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:52.420732 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88b2becc-6cca-4639-82cb-c366db9cac06 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:52.421503 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88b2becc-6cca-4639-82cb-c366db9cac06 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:52.421939 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-88b2becc-6cca-4639-82cb-c366db9cac06 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:52.554831 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-88b2becc-6cca-4639-82cb-c366db9cac06 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:52.563334 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-88b2becc-6cca-4639-82cb-c366db9cac06 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:52.564984 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-88b2becc-6cca-4639-82cb-c366db9cac06 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:52.566153 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-88b2becc-6cca-4639-82cb-c366db9cac06 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.157546 May 26 20:33:52.566785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 482/969] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:52 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 20:33:52.628634 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-b4986d75-14be-4814-8c98-f7db3c105218 req-d92abcaa-ed98-432f-ac46-81c0f721825e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a714b-7c67-466b-8448-e5a66aa434ee", "name": "network-vif-plugged", "status": "completed", "tag": "8aa75e2d-2a2c-43bc-809a-e911f84bfa6e"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:33:52.637856 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-b4986d75-14be-4814-8c98-f7db3c105218 req-d92abcaa-ed98-432f-ac46-81c0f721825e service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:52.643096 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-b4986d75-14be-4814-8c98-f7db3c105218 req-d92abcaa-ed98-432f-ac46-81c0f721825e service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:52.649409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-b4986d75-14be-4814-8c98-f7db3c105218 req-d92abcaa-ed98-432f-ac46-81c0f721825e service nova] Creating event network-vif-plugged:8aa75e2d-2a2c-43bc-809a-e911f84bfa6e for instance 0e8a714b-7c67-466b-8448-e5a66aa434ee on hv-cinder-84213 May 26 20:33:52.654447 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-b4986d75-14be-4814-8c98-f7db3c105218 req-d92abcaa-ed98-432f-ac46-81c0f721825e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029587 May 26 20:33:52.655025 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 483/970] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:33:52.829037 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7ad1f2bf-f2bb-4b14-bfce-98adfa01da36 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.090416 May 26 20:33:52.830708 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 488/971] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:33:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:33:52.841561 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9408f47c-2051-405b-bd11-1c6b88244c14 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:52.842383 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9408f47c-2051-405b-bd11-1c6b88244c14 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:52.916101 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-9408f47c-2051-405b-bd11-1c6b88244c14 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:52.922966 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9408f47c-2051-405b-bd11-1c6b88244c14 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1095 microversion: 2.1 time: 0.085920 May 26 20:33:52.923562 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 484/972] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:33:52 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:33:53.585074 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-658e3239-b754-421d-b477-2f238cecc362 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:53.585681 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-658e3239-b754-421d-b477-2f238cecc362 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:53.592080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-658e3239-b754-421d-b477-2f238cecc362 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:53.592525 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-658e3239-b754-421d-b477-2f238cecc362 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:53.593278 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-658e3239-b754-421d-b477-2f238cecc362 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:53.593707 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-658e3239-b754-421d-b477-2f238cecc362 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:53.731249 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-658e3239-b754-421d-b477-2f238cecc362 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:53.739115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-658e3239-b754-421d-b477-2f238cecc362 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:53.740773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-658e3239-b754-421d-b477-2f238cecc362 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:53.742363 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-658e3239-b754-421d-b477-2f238cecc362 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.161832 May 26 20:33:53.742927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 489/973] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:53 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:53.940095 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-22d63156-8f71-4ea8-9947-95ea6ef62f4c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:53.940711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-22d63156-8f71-4ea8-9947-95ea6ef62f4c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:53.948744 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22d63156-8f71-4ea8-9947-95ea6ef62f4c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:53.949230 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22d63156-8f71-4ea8-9947-95ea6ef62f4c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:53.949982 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22d63156-8f71-4ea8-9947-95ea6ef62f4c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:53.950475 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-22d63156-8f71-4ea8-9947-95ea6ef62f4c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:54.012785 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-22d63156-8f71-4ea8-9947-95ea6ef62f4c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:54.020315 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-22d63156-8f71-4ea8-9947-95ea6ef62f4c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1145 microversion: 2.1 time: 0.084100 May 26 20:33:54.028360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 485/974] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:33:53 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:33:54.760926 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2cab9e7c-6a92-408d-ab35-dc7c275448a1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:54.761476 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2cab9e7c-6a92-408d-ab35-dc7c275448a1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:54.767987 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2cab9e7c-6a92-408d-ab35-dc7c275448a1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:54.768432 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2cab9e7c-6a92-408d-ab35-dc7c275448a1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:54.769206 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2cab9e7c-6a92-408d-ab35-dc7c275448a1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:54.769638 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2cab9e7c-6a92-408d-ab35-dc7c275448a1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:54.902159 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2cab9e7c-6a92-408d-ab35-dc7c275448a1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:54.911881 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2cab9e7c-6a92-408d-ab35-dc7c275448a1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:54.913635 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2cab9e7c-6a92-408d-ab35-dc7c275448a1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:54.915136 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2cab9e7c-6a92-408d-ab35-dc7c275448a1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1731 microversion: 2.20 time: 0.158531 May 26 20:33:54.915646 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 490/975] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:54 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:55.037098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7862477d-1e76-44e9-ba70-3b6179dd7e9d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:55.037827 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7862477d-1e76-44e9-ba70-3b6179dd7e9d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:55.044433 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7862477d-1e76-44e9-ba70-3b6179dd7e9d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:55.044879 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7862477d-1e76-44e9-ba70-3b6179dd7e9d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:55.045647 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7862477d-1e76-44e9-ba70-3b6179dd7e9d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:55.046081 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7862477d-1e76-44e9-ba70-3b6179dd7e9d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:55.123217 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7862477d-1e76-44e9-ba70-3b6179dd7e9d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:55.131885 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7862477d-1e76-44e9-ba70-3b6179dd7e9d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1201 microversion: 2.1 time: 0.098271 May 26 20:33:55.132728 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 486/976] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:33:55 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1201 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:33:55.933730 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-61782c39-a53c-4103-9ce7-f483435400c9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:55.940955 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-61782c39-a53c-4103-9ce7-f483435400c9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:55.952731 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61782c39-a53c-4103-9ce7-f483435400c9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:55.952731 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61782c39-a53c-4103-9ce7-f483435400c9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:55.952731 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61782c39-a53c-4103-9ce7-f483435400c9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:55.952731 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61782c39-a53c-4103-9ce7-f483435400c9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:56.110266 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-61782c39-a53c-4103-9ce7-f483435400c9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:56.121782 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-61782c39-a53c-4103-9ce7-f483435400c9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:56.123353 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-61782c39-a53c-4103-9ce7-f483435400c9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:56.124729 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-61782c39-a53c-4103-9ce7-f483435400c9 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1718 microversion: 2.20 time: 0.195059 May 26 20:33:56.126503 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 491/977] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:33:55 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1718 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:33:56.149328 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c308dc4e-7ce3-4130-9f79-cf6a6f51a72b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:56.149926 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c308dc4e-7ce3-4130-9f79-cf6a6f51a72b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:56.157219 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c308dc4e-7ce3-4130-9f79-cf6a6f51a72b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:56.157812 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c308dc4e-7ce3-4130-9f79-cf6a6f51a72b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:56.158688 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c308dc4e-7ce3-4130-9f79-cf6a6f51a72b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:56.159195 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c308dc4e-7ce3-4130-9f79-cf6a6f51a72b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:56.402564 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c308dc4e-7ce3-4130-9f79-cf6a6f51a72b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:56.410134 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c308dc4e-7ce3-4130-9f79-cf6a6f51a72b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1279 microversion: 2.1 time: 0.265164 May 26 20:33:56.410738 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 487/978] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:33:56 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1279 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:33:56.988175 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-f396972a-e623-4434-aeef-15e6b2dc125d req-309717fd-7bf0-46ea-96dc-cb05af1f5462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92432aae-7fac-49c2-a428-788d808b0a02", "tag": "fea27c8a-2e65-4ae0-ac6b-965bd395e683"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:33:56.997755 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-f396972a-e623-4434-aeef-15e6b2dc125d req-309717fd-7bf0-46ea-96dc-cb05af1f5462 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:57.003328 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-f396972a-e623-4434-aeef-15e6b2dc125d req-309717fd-7bf0-46ea-96dc-cb05af1f5462 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:57.011389 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-f396972a-e623-4434-aeef-15e6b2dc125d req-309717fd-7bf0-46ea-96dc-cb05af1f5462 service nova] Creating event network-changed:fea27c8a-2e65-4ae0-ac6b-965bd395e683 for instance 92432aae-7fac-49c2-a428-788d808b0a02 on hv-cinder-84213 May 26 20:33:57.016619 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-f396972a-e623-4434-aeef-15e6b2dc125d req-309717fd-7bf0-46ea-96dc-cb05af1f5462 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032855 May 26 20:33:57.017444 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 492/979] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:33:57.428360 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-228e1822-4bc6-4d73-bda7-377b8ee052dd tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:57.428983 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-228e1822-4bc6-4d73-bda7-377b8ee052dd tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:57.437632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-228e1822-4bc6-4d73-bda7-377b8ee052dd tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:57.437632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-228e1822-4bc6-4d73-bda7-377b8ee052dd tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:57.437632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-228e1822-4bc6-4d73-bda7-377b8ee052dd tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:57.437632 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-228e1822-4bc6-4d73-bda7-377b8ee052dd tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:57.644228 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-228e1822-4bc6-4d73-bda7-377b8ee052dd tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:57.652616 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-228e1822-4bc6-4d73-bda7-377b8ee052dd tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1267 microversion: 2.1 time: 0.228216 May 26 20:33:57.653696 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 488/980] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:33:57 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:33:58.681418 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-17d253fb-7ee0-43e9-a936-e06e3d588fc6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:58.682135 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-17d253fb-7ee0-43e9-a936-e06e3d588fc6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:58.688864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-17d253fb-7ee0-43e9-a936-e06e3d588fc6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:58.689323 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-17d253fb-7ee0-43e9-a936-e06e3d588fc6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:58.690084 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-17d253fb-7ee0-43e9-a936-e06e3d588fc6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:58.690551 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-17d253fb-7ee0-43e9-a936-e06e3d588fc6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:58.821106 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-17d253fb-7ee0-43e9-a936-e06e3d588fc6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:33:58.828555 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-17d253fb-7ee0-43e9-a936-e06e3d588fc6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1267 microversion: 2.1 time: 0.151533 May 26 20:33:58.829214 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 493/981] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:33:58 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:33:59.846659 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-36323f9d-43bd-419d-b0d0-540794c76b67 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:33:59.847310 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-36323f9d-43bd-419d-b0d0-540794c76b67 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:33:59.854073 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-36323f9d-43bd-419d-b0d0-540794c76b67 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:59.854551 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-36323f9d-43bd-419d-b0d0-540794c76b67 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:33:59.855333 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-36323f9d-43bd-419d-b0d0-540794c76b67 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:33:59.855771 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-36323f9d-43bd-419d-b0d0-540794c76b67 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:00.005701 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-36323f9d-43bd-419d-b0d0-540794c76b67 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:00.014011 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-36323f9d-43bd-419d-b0d0-540794c76b67 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1267 microversion: 2.1 time: 0.171176 May 26 20:34:00.014620 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 489/982] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:33:59 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:34:01.031255 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-556a4997-44b9-4a6f-aa6f-091847e8bfa1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:01.031910 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-556a4997-44b9-4a6f-aa6f-091847e8bfa1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:01.038608 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-556a4997-44b9-4a6f-aa6f-091847e8bfa1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:01.044319 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-556a4997-44b9-4a6f-aa6f-091847e8bfa1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:01.044319 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-556a4997-44b9-4a6f-aa6f-091847e8bfa1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:01.044319 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-556a4997-44b9-4a6f-aa6f-091847e8bfa1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:01.168963 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-556a4997-44b9-4a6f-aa6f-091847e8bfa1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:01.176458 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-556a4997-44b9-4a6f-aa6f-091847e8bfa1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1267 microversion: 2.1 time: 0.149151 May 26 20:34:01.177015 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 494/983] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:34:01 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:34:02.193539 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d350f560-e6b6-4b77-a281-848e02964ecc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:02.194155 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d350f560-e6b6-4b77-a281-848e02964ecc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:02.201038 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d350f560-e6b6-4b77-a281-848e02964ecc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:02.201488 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d350f560-e6b6-4b77-a281-848e02964ecc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:02.202278 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d350f560-e6b6-4b77-a281-848e02964ecc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:02.202725 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d350f560-e6b6-4b77-a281-848e02964ecc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:02.339676 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-d350f560-e6b6-4b77-a281-848e02964ecc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:02.347122 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d350f560-e6b6-4b77-a281-848e02964ecc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1267 microversion: 2.1 time: 0.157507 May 26 20:34:02.347693 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 490/984] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:34:02 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:34:03.368238 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c314e389-0d62-4fad-a225-4723c040441c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:03.369004 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c314e389-0d62-4fad-a225-4723c040441c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:03.371570 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:34:03.376246 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=6 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:34:03.379484 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c314e389-0d62-4fad-a225-4723c040441c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:03.380165 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c314e389-0d62-4fad-a225-4723c040441c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:03.381247 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c314e389-0d62-4fad-a225-4723c040441c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:03.381683 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c314e389-0d62-4fad-a225-4723c040441c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:03.515284 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c314e389-0d62-4fad-a225-4723c040441c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:03.522770 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c314e389-0d62-4fad-a225-4723c040441c tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1267 microversion: 2.1 time: 0.161475 May 26 20:34:03.524001 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 495/985] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:34:03 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:34:04.540768 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f0e501e6-2ec9-412a-bc98-2bdf6f1fc661 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:04.541310 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f0e501e6-2ec9-412a-bc98-2bdf6f1fc661 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:04.543424 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:34:04.548854 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0e501e6-2ec9-412a-bc98-2bdf6f1fc661 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:04.549415 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0e501e6-2ec9-412a-bc98-2bdf6f1fc661 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:04.550263 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0e501e6-2ec9-412a-bc98-2bdf6f1fc661 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:04.550792 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f0e501e6-2ec9-412a-bc98-2bdf6f1fc661 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:04.555711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:34:04.685904 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f0e501e6-2ec9-412a-bc98-2bdf6f1fc661 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:04.693412 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f0e501e6-2ec9-412a-bc98-2bdf6f1fc661 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1267 microversion: 2.1 time: 0.157097 May 26 20:34:04.693990 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 491/986] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:34:04 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:34:05.712270 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-35fa6f60-9824-4ac9-a8a8-69be14651aea tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:05.713240 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-35fa6f60-9824-4ac9-a8a8-69be14651aea tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:05.716397 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:34:05.722885 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-35fa6f60-9824-4ac9-a8a8-69be14651aea tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:05.723385 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-35fa6f60-9824-4ac9-a8a8-69be14651aea tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:05.724246 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-35fa6f60-9824-4ac9-a8a8-69be14651aea tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:05.724969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-35fa6f60-9824-4ac9-a8a8-69be14651aea tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:05.857972 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-35fa6f60-9824-4ac9-a8a8-69be14651aea tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:05.865444 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-35fa6f60-9824-4ac9-a8a8-69be14651aea tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1267 microversion: 2.1 time: 0.158152 May 26 20:34:05.866036 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 496/987] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:34:05 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:34:06.829267 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-48e799e7-4044-4e97-9b3d-11808c8b3043 req-2ea69f9f-5bb6-49d0-8634-79e318746503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92432aae-7fac-49c2-a428-788d808b0a02", "name": "network-vif-plugged", "status": "completed", "tag": "fea27c8a-2e65-4ae0-ac6b-965bd395e683"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:34:06.840484 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-48e799e7-4044-4e97-9b3d-11808c8b3043 req-2ea69f9f-5bb6-49d0-8634-79e318746503 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:06.840869 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-48e799e7-4044-4e97-9b3d-11808c8b3043 req-2ea69f9f-5bb6-49d0-8634-79e318746503 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:06.852183 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-48e799e7-4044-4e97-9b3d-11808c8b3043 req-2ea69f9f-5bb6-49d0-8634-79e318746503 service nova] Creating event network-vif-plugged:fea27c8a-2e65-4ae0-ac6b-965bd395e683 for instance 92432aae-7fac-49c2-a428-788d808b0a02 on hv-cinder-84213 May 26 20:34:06.857147 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-48e799e7-4044-4e97-9b3d-11808c8b3043 req-2ea69f9f-5bb6-49d0-8634-79e318746503 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031653 May 26 20:34:06.857734 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 492/988] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:34:06.887253 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0a55d817-47a8-4e25-9f0d-0e0f05785ad8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:06.888357 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0a55d817-47a8-4e25-9f0d-0e0f05785ad8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:06.902405 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0a55d817-47a8-4e25-9f0d-0e0f05785ad8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:06.903223 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0a55d817-47a8-4e25-9f0d-0e0f05785ad8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:06.904867 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0a55d817-47a8-4e25-9f0d-0e0f05785ad8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:06.905765 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0a55d817-47a8-4e25-9f0d-0e0f05785ad8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:06.936149 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:34:07.062986 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-0a55d817-47a8-4e25-9f0d-0e0f05785ad8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:07.071448 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0a55d817-47a8-4e25-9f0d-0e0f05785ad8 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1267 microversion: 2.1 time: 0.191854 May 26 20:34:07.072062 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 497/989] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:34:06 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:34:08.090196 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-de7b23b3-a6ad-4824-8ecd-e791419329bc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:08.090846 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-de7b23b3-a6ad-4824-8ecd-e791419329bc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:08.097007 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-de7b23b3-a6ad-4824-8ecd-e791419329bc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:08.097452 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-de7b23b3-a6ad-4824-8ecd-e791419329bc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:08.098286 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-de7b23b3-a6ad-4824-8ecd-e791419329bc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:08.098720 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-de7b23b3-a6ad-4824-8ecd-e791419329bc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:08.233557 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-de7b23b3-a6ad-4824-8ecd-e791419329bc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:08.242793 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-de7b23b3-a6ad-4824-8ecd-e791419329bc tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1267 microversion: 2.1 time: 0.157197 May 26 20:34:08.244451 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 493/990] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:34:08 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:34:09.260247 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9af24d6e-5dd6-4ae7-a733-b0f54df7ddff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:09.260785 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9af24d6e-5dd6-4ae7-a733-b0f54df7ddff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:09.268088 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9af24d6e-5dd6-4ae7-a733-b0f54df7ddff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:09.268537 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9af24d6e-5dd6-4ae7-a733-b0f54df7ddff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:09.269291 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9af24d6e-5dd6-4ae7-a733-b0f54df7ddff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:09.269717 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9af24d6e-5dd6-4ae7-a733-b0f54df7ddff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:09.398197 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9af24d6e-5dd6-4ae7-a733-b0f54df7ddff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:09.406647 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9af24d6e-5dd6-4ae7-a733-b0f54df7ddff tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1455 microversion: 2.1 time: 0.150561 May 26 20:34:09.407349 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 498/991] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:34:09 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:34:09.422586 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-6d4d4bb9-05fb-4e75-ad72-38a5fd76d27b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:09.423204 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-6d4d4bb9-05fb-4e75-ad72-38a5fd76d27b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:09.425575 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=38 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:34:09.430414 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d4d4bb9-05fb-4e75-ad72-38a5fd76d27b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:09.430869 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d4d4bb9-05fb-4e75-ad72-38a5fd76d27b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:09.431641 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d4d4bb9-05fb-4e75-ad72-38a5fd76d27b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:09.432086 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-6d4d4bb9-05fb-4e75-ad72-38a5fd76d27b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:09.561396 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-6d4d4bb9-05fb-4e75-ad72-38a5fd76d27b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:09.569047 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-6d4d4bb9-05fb-4e75-ad72-38a5fd76d27b tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1455 microversion: 2.1 time: 0.150414 May 26 20:34:09.569610 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 494/992] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:34:09 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:34:11.716870 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-c0cdf166-17f4-4129-a0aa-5682fa7f461f req-b5c2c429-dab2-4178-84e0-bd6adde895e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92432aae-7fac-49c2-a428-788d808b0a02", "tag": "fea27c8a-2e65-4ae0-ac6b-965bd395e683"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:34:11.724852 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-c0cdf166-17f4-4129-a0aa-5682fa7f461f req-b5c2c429-dab2-4178-84e0-bd6adde895e0 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:11.725289 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-c0cdf166-17f4-4129-a0aa-5682fa7f461f req-b5c2c429-dab2-4178-84e0-bd6adde895e0 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:11.736071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-c0cdf166-17f4-4129-a0aa-5682fa7f461f req-b5c2c429-dab2-4178-84e0-bd6adde895e0 service nova] Creating event network-changed:fea27c8a-2e65-4ae0-ac6b-965bd395e683 for instance 92432aae-7fac-49c2-a428-788d808b0a02 on hv-cinder-84213 May 26 20:34:11.741100 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-c0cdf166-17f4-4129-a0aa-5682fa7f461f req-b5c2c429-dab2-4178-84e0-bd6adde895e0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088533 May 26 20:34:11.741672 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 499/993] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:34:29.558513 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3f39ffde-02d7-4f1a-94f4-513eabe5b573 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:29.559442 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3f39ffde-02d7-4f1a-94f4-513eabe5b573 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:29.561471 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:34:29.562270 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=19 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:34:29.566825 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3f39ffde-02d7-4f1a-94f4-513eabe5b573 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:29.567277 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3f39ffde-02d7-4f1a-94f4-513eabe5b573 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:29.568044 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3f39ffde-02d7-4f1a-94f4-513eabe5b573 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:29.568481 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3f39ffde-02d7-4f1a-94f4-513eabe5b573 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:29.597819 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3f39ffde-02d7-4f1a-94f4-513eabe5b573 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044317 May 26 20:34:29.598400 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 495/994] 10.222.0.44 () {60 vars in 1342 bytes} [Thu May 26 20:34:29 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:34:29.653707 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=7 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:34:29.654563 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=13 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:34:29.658612 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2d3c2c5d-326a-4571-885b-5260b05b1f53 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:29.664117 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2d3c2c5d-326a-4571-885b-5260b05b1f53 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:29.666111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2d3c2c5d-326a-4571-885b-5260b05b1f53 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:29.666602 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2d3c2c5d-326a-4571-885b-5260b05b1f53 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:29.667357 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2d3c2c5d-326a-4571-885b-5260b05b1f53 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:29.667790 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2d3c2c5d-326a-4571-885b-5260b05b1f53 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:29.693019 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2d3c2c5d-326a-4571-885b-5260b05b1f53 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Going to try to terminate instance {{(pid=118306) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:34:29.923533 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2d3c2c5d-326a-4571-885b-5260b05b1f53 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 204 len: 0 microversion: 2.20 time: 0.271082 May 26 20:34:29.924071 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 500/995] 10.222.0.44 () {60 vars in 1279 bytes} [Thu May 26 20:34:29 2022] DELETE /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 20:34:29.932759 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-b591f7c4-b684-4ce0-b850-1f3d7d7fb665 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:29.937401 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-b591f7c4-b684-4ce0-b850-1f3d7d7fb665 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:29.939573 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b591f7c4-b684-4ce0-b850-1f3d7d7fb665 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:29.940023 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b591f7c4-b684-4ce0-b850-1f3d7d7fb665 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:29.940775 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b591f7c4-b684-4ce0-b850-1f3d7d7fb665 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:29.941208 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-b591f7c4-b684-4ce0-b850-1f3d7d7fb665 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:30.073190 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b591f7c4-b684-4ce0-b850-1f3d7d7fb665 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:30.081423 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b591f7c4-b684-4ce0-b850-1f3d7d7fb665 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:30.082963 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-b591f7c4-b684-4ce0-b850-1f3d7d7fb665 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:30.084119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-b591f7c4-b684-4ce0-b850-1f3d7d7fb665 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1724 microversion: 2.20 time: 0.155656 May 26 20:34:30.084681 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 496/996] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:34:29 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:34:31.103701 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-88104a52-9770-4743-a317-c24e5ca1de10 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:31.104392 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-88104a52-9770-4743-a317-c24e5ca1de10 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:31.110827 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-88104a52-9770-4743-a317-c24e5ca1de10 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:31.111273 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-88104a52-9770-4743-a317-c24e5ca1de10 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:31.112021 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-88104a52-9770-4743-a317-c24e5ca1de10 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:31.112449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-88104a52-9770-4743-a317-c24e5ca1de10 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:31.240183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-88104a52-9770-4743-a317-c24e5ca1de10 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:31.248554 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-88104a52-9770-4743-a317-c24e5ca1de10 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:31.250041 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-88104a52-9770-4743-a317-c24e5ca1de10 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:31.251208 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-88104a52-9770-4743-a317-c24e5ca1de10 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1724 microversion: 2.20 time: 0.151816 May 26 20:34:31.251762 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 501/997] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:34:31 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:34:32.252629 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-2a5c8fdf-b034-43b8-a2d9-b06c2d5a6f8e req-7df882eb-37eb-47c3-95d9-37f564560fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a714b-7c67-466b-8448-e5a66aa434ee", "name": "network-vif-deleted", "tag": "8aa75e2d-2a2c-43bc-809a-e911f84bfa6e"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:34:32.261641 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-2a5c8fdf-b034-43b8-a2d9-b06c2d5a6f8e req-7df882eb-37eb-47c3-95d9-37f564560fd9 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:32.262087 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-2a5c8fdf-b034-43b8-a2d9-b06c2d5a6f8e req-7df882eb-37eb-47c3-95d9-37f564560fd9 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:32.270505 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e2914902-e63f-40d3-97f0-b30116055c99 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:32.271703 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e2914902-e63f-40d3-97f0-b30116055c99 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:32.275754 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-2a5c8fdf-b034-43b8-a2d9-b06c2d5a6f8e req-7df882eb-37eb-47c3-95d9-37f564560fd9 service nova] Creating event network-vif-deleted:8aa75e2d-2a2c-43bc-809a-e911f84bfa6e for instance 0e8a714b-7c67-466b-8448-e5a66aa434ee on hv-cinder-84213 May 26 20:34:32.279552 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e2914902-e63f-40d3-97f0-b30116055c99 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:32.280074 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e2914902-e63f-40d3-97f0-b30116055c99 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:32.280984 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e2914902-e63f-40d3-97f0-b30116055c99 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:32.281607 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e2914902-e63f-40d3-97f0-b30116055c99 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:32.289375 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-2a5c8fdf-b034-43b8-a2d9-b06c2d5a6f8e req-7df882eb-37eb-47c3-95d9-37f564560fd9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039853 May 26 20:34:32.290273 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 497/998] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:34:32.360645 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e2914902-e63f-40d3-97f0-b30116055c99 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:32.369757 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e2914902-e63f-40d3-97f0-b30116055c99 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:32.371709 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e2914902-e63f-40d3-97f0-b30116055c99 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ecdb952539f401aba5e0f91c3dd8660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df1452f8d474ea9b121f4aef1793af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:34:32.372889 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e2914902-e63f-40d3-97f0-b30116055c99 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 200 len: 1656 microversion: 2.20 time: 0.106536 May 26 20:34:32.374233 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 502/999] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:34:32 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 1656 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 20:34:33.393207 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-17d6cf16-b20d-4c05-8832-e2b9200dd7d7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:33.399711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-17d6cf16-b20d-4c05-8832-e2b9200dd7d7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:33.400886 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17d6cf16-b20d-4c05-8832-e2b9200dd7d7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:33.401334 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17d6cf16-b20d-4c05-8832-e2b9200dd7d7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:33.402104 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17d6cf16-b20d-4c05-8832-e2b9200dd7d7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:33.402568 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-17d6cf16-b20d-4c05-8832-e2b9200dd7d7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:33.416400 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-17d6cf16-b20d-4c05-8832-e2b9200dd7d7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] HTTP exception thrown: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-17d6cf16-b20d-4c05-8832-e2b9200dd7d7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Request method failure captured: May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee HTTP/1.1 May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-MStVNRquOEBB0j7pTT50IiiMc7Jgl--9w_JdLQRGwbTW8-agHKiXTnBTyqUB4aWgxQEUa7ADpuHJZvac095kGR-6etdDDi7NLr4g5ng744pFbINSCSL55Na_kmu50uv656rSHrV7X2prCCdBSAsRhR61v4hv_wGSUAdD-1XyGywjc May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Openstack-Nova-Api-Version: 2.20 May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 4df1452f8d474ea9b121f4aef1793af8 May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:34:33.418113 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:34:33.419938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:34:33.419938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:33.419938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 4df1452f8d474ea9b121f4aef1793af8 May 26 20:34:33.419938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:33.419938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeShelveTestJSON-958965953-project May 26 20:34:33.419938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:34:33.419938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:34:33.419938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 2ecdb952539f401aba5e0f91c3dd8660 May 26 20:34:33.419938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-958965953-project May 26 20:34:33.419938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:34:33.419938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:33.419938 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '0e8a714b-7c67-466b-8448-e5a66aa434ee'} May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:34:33.420974 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:33.422631 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:33.424239 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-17d6cf16-b20d-4c05-8832-e2b9200dd7d7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Returning 404 to user: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:34:33.424239 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-17d6cf16-b20d-4c05-8832-e2b9200dd7d7 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 404 len: 111 microversion: 2.20 time: 0.031254 May 26 20:34:33.424239 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 498/1000] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:34:33 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 20:34:33.430068 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-3375e75d-df2f-4272-bca3-f5b46f785a6e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '.version_select at 0x7f2da49b88b0>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:33.500598 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-3375e75d-df2f-4272-bca3-f5b46f785a6e tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-427037837" status: 204 len: 0 microversion: 2.20 time: 0.074864 May 26 20:34:33.501168 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 503/1001] 10.222.0.44 () {60 vars in 1258 bytes} [Thu May 26 20:34:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-427037837 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 20:34:35.570377 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1d42e987-35f3-473c-a36c-bdf5a7008df1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:35.570896 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1d42e987-35f3-473c-a36c-bdf5a7008df1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:35.577238 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d42e987-35f3-473c-a36c-bdf5a7008df1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:35.577685 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d42e987-35f3-473c-a36c-bdf5a7008df1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:35.578485 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d42e987-35f3-473c-a36c-bdf5a7008df1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:35.578914 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1d42e987-35f3-473c-a36c-bdf5a7008df1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:35.592459 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-1d42e987-35f3-473c-a36c-bdf5a7008df1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] HTTP exception thrown: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1d42e987-35f3-473c-a36c-bdf5a7008df1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Request method failure captured: May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: DELETE /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee HTTP/1.1 May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-MStVNRquOEBB0j7pTT50IiiMc7Jgl--9w_JdLQRGwbTW8-agHKiXTnBTyqUB4aWgxQEUa7ADpuHJZvac095kGR-6etdDDi7NLr4g5ng744pFbINSCSL55Na_kmu50uv656rSHrV7X2prCCdBSAsRhR61v4hv_wGSUAdD-1XyGywjc May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Openstack-Nova-Api-Version: 2.20 May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 4df1452f8d474ea9b121f4aef1793af8 May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:34:35.593976 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:34:35.595716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:34:35.595716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:35.595716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 4df1452f8d474ea9b121f4aef1793af8 May 26 20:34:35.595716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:35.595716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeShelveTestJSON-958965953-project May 26 20:34:35.595716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:34:35.595716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:34:35.595716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 2ecdb952539f401aba5e0f91c3dd8660 May 26 20:34:35.595716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-958965953-project May 26 20:34:35.595716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:34:35.595716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:35.595716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '0e8a714b-7c67-466b-8448-e5a66aa434ee'} May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:34:35.596764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:35.598191 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:35.599783 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1d42e987-35f3-473c-a36c-bdf5a7008df1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Returning 404 to user: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:34:35.599783 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1d42e987-35f3-473c-a36c-bdf5a7008df1 tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 404 len: 111 microversion: 2.20 time: 0.028942 May 26 20:34:35.599783 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 499/1002] 10.222.0.44 () {60 vars in 1279 bytes} [Thu May 26 20:34:35 2022] DELETE /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 20:34:35.604706 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-dcd580c1-66bf-483a-bd8c-4c36258ebd4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:35.605434 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-dcd580c1-66bf-483a-bd8c-4c36258ebd4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 0e8a714b-7c67-466b-8448-e5a66aa434ee] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:35.612104 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dcd580c1-66bf-483a-bd8c-4c36258ebd4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:35.612560 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dcd580c1-66bf-483a-bd8c-4c36258ebd4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:35.613352 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dcd580c1-66bf-483a-bd8c-4c36258ebd4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:35.613790 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dcd580c1-66bf-483a-bd8c-4c36258ebd4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:35.627826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-dcd580c1-66bf-483a-bd8c-4c36258ebd4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] HTTP exception thrown: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-dcd580c1-66bf-483a-bd8c-4c36258ebd4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Request method failure captured: May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee HTTP/1.1 May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-MStVNRquOEBB0j7pTT50IiiMc7Jgl--9w_JdLQRGwbTW8-agHKiXTnBTyqUB4aWgxQEUa7ADpuHJZvac095kGR-6etdDDi7NLr4g5ng744pFbINSCSL55Na_kmu50uv656rSHrV7X2prCCdBSAsRhR61v4hv_wGSUAdD-1XyGywjc May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Openstack-Nova-Api-Version: 2.20 May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: 4df1452f8d474ea9b121f4aef1793af8 May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:34:35.629487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:34:35.631183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:34:35.631183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:35.631183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: 4df1452f8d474ea9b121f4aef1793af8 May 26 20:34:35.631183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:35.631183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-AttachVolumeShelveTestJSON-958965953-project May 26 20:34:35.631183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:34:35.631183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:34:35.631183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: 2ecdb952539f401aba5e0f91c3dd8660 May 26 20:34:35.631183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-AttachVolumeShelveTestJSON-958965953-project May 26 20:34:35.631183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:34:35.631183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:35.631183 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '0e8a714b-7c67-466b-8448-e5a66aa434ee'} May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:34:35.632111 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. May 26 20:34:35.633562 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:34:35.634780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-dcd580c1-66bf-483a-bd8c-4c36258ebd4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Returning 404 to user: Instance 0e8a714b-7c67-466b-8448-e5a66aa434ee could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:34:35.634780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-dcd580c1-66bf-483a-bd8c-4c36258ebd4b tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee" status: 404 len: 111 microversion: 2.20 time: 0.031043 May 26 20:34:35.634780 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 504/1003] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:34:35 2022] GET /compute/v2.1/servers/0e8a714b-7c67-466b-8448-e5a66aa434ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 20:34:36.931481 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-58611fbb-75c7-4428-9be2-b35f6e2c8c8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:36.932010 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-58611fbb-75c7-4428-9be2-b35f6e2c8c8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:36.938551 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58611fbb-75c7-4428-9be2-b35f6e2c8c8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:36.938990 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58611fbb-75c7-4428-9be2-b35f6e2c8c8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:36.939758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58611fbb-75c7-4428-9be2-b35f6e2c8c8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:36.940195 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-58611fbb-75c7-4428-9be2-b35f6e2c8c8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:36.953560 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-58611fbb-75c7-4428-9be2-b35f6e2c8c8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] HTTP exception thrown: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-58611fbb-75c7-4428-9be2-b35f6e2c8c8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Request method failure captured: May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: DELETE /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db HTTP/1.1 May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-MStVNRquOEBB0j7pTT50IiiMc7Jgl--9w_JdLQRGwbTW8-agHKiXTnBTyqUB4aWgxQEUa7ADpuHJZvac095kGR-6etdDDi7NLr4g5ng744pFbINSCSL55Na_kmu50uv656rSHrV7X2prCCdBSAsRhR61v4hv_wGSUAdD-1XyGywjc May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Openstack-Nova-Api-Version: 2.20 May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 4df1452f8d474ea9b121f4aef1793af8 May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:34:36.955119 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:34:36.956743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:34:36.956743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:36.956743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 4df1452f8d474ea9b121f4aef1793af8 May 26 20:34:36.956743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:36.956743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-AttachVolumeShelveTestJSON-958965953-project May 26 20:34:36.956743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:34:36.956743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:34:36.956743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 2ecdb952539f401aba5e0f91c3dd8660 May 26 20:34:36.956743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-958965953-project May 26 20:34:36.956743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:34:36.956743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:34:36.956743 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '419dd0d9-334f-4481-aa27-8c24115614db'} May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:34:36.957713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:34:36.959223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:34:36.961311 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-58611fbb-75c7-4428-9be2-b35f6e2c8c8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Returning 404 to user: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:34:36.961311 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-58611fbb-75c7-4428-9be2-b35f6e2c8c8d tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "DELETE /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 404 len: 111 microversion: 2.20 time: 0.029586 May 26 20:34:36.961311 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 500/1004] 10.222.0.44 () {60 vars in 1279 bytes} [Thu May 26 20:34:36 2022] DELETE /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 20:34:36.965725 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-790671d5-c399-4565-b158-91ffdadf85ab tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:34:36.966385 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-790671d5-c399-4565-b158-91ffdadf85ab tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] [instance: 419dd0d9-334f-4481-aa27-8c24115614db] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:34:36.972920 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-790671d5-c399-4565-b158-91ffdadf85ab tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:36.973366 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-790671d5-c399-4565-b158-91ffdadf85ab tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:36.974126 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-790671d5-c399-4565-b158-91ffdadf85ab tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:34:36.974585 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-790671d5-c399-4565-b158-91ffdadf85ab tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:34:36.988916 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-790671d5-c399-4565-b158-91ffdadf85ab tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] HTTP exception thrown: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-790671d5-c399-4565-b158-91ffdadf85ab tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Request method failure captured: May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db HTTP/1.1 May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-MStVNRquOEBB0j7pTT50IiiMc7Jgl--9w_JdLQRGwbTW8-agHKiXTnBTyqUB4aWgxQEUa7ADpuHJZvac095kGR-6etdDDi7NLr4g5ng744pFbINSCSL55Na_kmu50uv656rSHrV7X2prCCdBSAsRhR61v4hv_wGSUAdD-1XyGywjc May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Openstack-Nova-Api-Version: 2.20 May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: 4df1452f8d474ea9b121f4aef1793af8 May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:34:36.990454 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:34:36.992860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4df1452f8d474ea9b121f4aef1793af8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:34:36.992860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:36.992860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: 4df1452f8d474ea9b121f4aef1793af8 May 26 20:34:36.992860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-958965953 May 26 20:34:36.992860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-AttachVolumeShelveTestJSON-958965953-project May 26 20:34:36.992860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:34:36.992860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:34:36.992860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: 2ecdb952539f401aba5e0f91c3dd8660 May 26 20:34:36.992860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-AttachVolumeShelveTestJSON-958965953-project May 26 20:34:36.992860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:34:36.992860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:34:36.992860 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '419dd0d9-334f-4481-aa27-8c24115614db'} May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:34:36.993787 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. May 26 20:34:36.995123 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:34:36.996211 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-790671d5-c399-4565-b158-91ffdadf85ab tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] Returning 404 to user: Instance 419dd0d9-334f-4481-aa27-8c24115614db could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:34:36.996211 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-790671d5-c399-4565-b158-91ffdadf85ab tempest-AttachVolumeShelveTestJSON-958965953 tempest-AttachVolumeShelveTestJSON-958965953-project] 10.222.0.44 "GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db" status: 404 len: 111 microversion: 2.20 time: 0.031144 May 26 20:34:36.996211 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 505/1005] 10.222.0.44 () {60 vars in 1276 bytes} [Thu May 26 20:34:36 2022] GET /compute/v2.1/servers/419dd0d9-334f-4481-aa27-8c24115614db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 20:35:51.631950 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=12 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:35:51.634777 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=20 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:35:51.635863 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:35:51.637372 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:35:51.641548 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9a32d960-8dbf-4d45-9a8b-00ee1e7b5feb tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:35:51.642190 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9a32d960-8dbf-4d45-9a8b-00ee1e7b5feb tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:35:51.649644 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a32d960-8dbf-4d45-9a8b-00ee1e7b5feb tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:51.650997 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a32d960-8dbf-4d45-9a8b-00ee1e7b5feb tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:51.651898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a32d960-8dbf-4d45-9a8b-00ee1e7b5feb tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:51.652487 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-9a32d960-8dbf-4d45-9a8b-00ee1e7b5feb tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:51.681382 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-9a32d960-8dbf-4d45-9a8b-00ee1e7b5feb tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:35:51.800193 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-d468b42e-f35b-4026-aafc-81e8d86bc39d req-28243e4f-cf5c-4319-8e0f-6d25012dbde9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92432aae-7fac-49c2-a428-788d808b0a02", "tag": "fea27c8a-2e65-4ae0-ac6b-965bd395e683"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:35:51.821380 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-d468b42e-f35b-4026-aafc-81e8d86bc39d req-28243e4f-cf5c-4319-8e0f-6d25012dbde9 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:51.824144 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-d468b42e-f35b-4026-aafc-81e8d86bc39d req-28243e4f-cf5c-4319-8e0f-6d25012dbde9 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:51.835559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-d468b42e-f35b-4026-aafc-81e8d86bc39d req-28243e4f-cf5c-4319-8e0f-6d25012dbde9 service nova] Creating event network-changed:fea27c8a-2e65-4ae0-ac6b-965bd395e683 for instance 92432aae-7fac-49c2-a428-788d808b0a02 on hv-cinder-84213 May 26 20:35:51.841404 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-d468b42e-f35b-4026-aafc-81e8d86bc39d req-28243e4f-cf5c-4319-8e0f-6d25012dbde9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211553 May 26 20:35:51.848278 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 506/1006] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:35:51.985594 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9a32d960-8dbf-4d45-9a8b-00ee1e7b5feb tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "DELETE /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 204 len: 0 microversion: 2.1 time: 0.357807 May 26 20:35:51.986763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 501/1007] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:35:51 2022] DELETE /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:35:51.997379 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9b97bdb1-9863-4fbb-82de-66e6e551efc1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:35:51.998340 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9b97bdb1-9863-4fbb-82de-66e6e551efc1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:35:52.005409 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9b97bdb1-9863-4fbb-82de-66e6e551efc1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:52.006475 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9b97bdb1-9863-4fbb-82de-66e6e551efc1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:52.007294 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9b97bdb1-9863-4fbb-82de-66e6e551efc1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:52.007723 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9b97bdb1-9863-4fbb-82de-66e6e551efc1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:52.169011 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9b97bdb1-9863-4fbb-82de-66e6e551efc1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:35:52.175032 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9b97bdb1-9863-4fbb-82de-66e6e551efc1 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1580 microversion: 2.1 time: 0.183052 May 26 20:35:52.175714 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 507/1008] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:35:51 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1580 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:35:53.199564 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-421ecaed-b028-486c-b7e2-b87f2d5436f3 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:35:53.200291 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-421ecaed-b028-486c-b7e2-b87f2d5436f3 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:35:53.210736 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-421ecaed-b028-486c-b7e2-b87f2d5436f3 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:53.211186 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-421ecaed-b028-486c-b7e2-b87f2d5436f3 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:53.211969 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-421ecaed-b028-486c-b7e2-b87f2d5436f3 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:53.212409 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-421ecaed-b028-486c-b7e2-b87f2d5436f3 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:53.538564 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-421ecaed-b028-486c-b7e2-b87f2d5436f3 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:35:53.546817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-421ecaed-b028-486c-b7e2-b87f2d5436f3 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1580 microversion: 2.1 time: 0.355720 May 26 20:35:53.547613 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 502/1009] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:35:53 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1580 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:35:54.416182 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-765624d8-4768-4386-bc75-6808adff5118 req-a463617d-7b57-4f2d-8361-dca46bb43fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92432aae-7fac-49c2-a428-788d808b0a02", "name": "network-vif-deleted", "tag": "fea27c8a-2e65-4ae0-ac6b-965bd395e683"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:35:54.420578 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-765624d8-4768-4386-bc75-6808adff5118 req-a463617d-7b57-4f2d-8361-dca46bb43fea service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:54.421093 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-765624d8-4768-4386-bc75-6808adff5118 req-a463617d-7b57-4f2d-8361-dca46bb43fea service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:54.433254 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-765624d8-4768-4386-bc75-6808adff5118 req-a463617d-7b57-4f2d-8361-dca46bb43fea service nova] Creating event network-vif-deleted:fea27c8a-2e65-4ae0-ac6b-965bd395e683 for instance 92432aae-7fac-49c2-a428-788d808b0a02 on hv-cinder-84213 May 26 20:35:54.438571 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-765624d8-4768-4386-bc75-6808adff5118 req-a463617d-7b57-4f2d-8361-dca46bb43fea service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035004 May 26 20:35:54.439861 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 508/1010] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:35:54.564808 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-aba8eed6-a680-4d34-8e79-98152a250e9a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:35:54.566024 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-aba8eed6-a680-4d34-8e79-98152a250e9a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:35:54.573801 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aba8eed6-a680-4d34-8e79-98152a250e9a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:54.574731 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aba8eed6-a680-4d34-8e79-98152a250e9a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:54.585764 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aba8eed6-a680-4d34-8e79-98152a250e9a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:54.587506 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-aba8eed6-a680-4d34-8e79-98152a250e9a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:54.699089 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-aba8eed6-a680-4d34-8e79-98152a250e9a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:35:54.752898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-aba8eed6-a680-4d34-8e79-98152a250e9a tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 200 len: 1226 microversion: 2.1 time: 0.146446 May 26 20:35:54.752898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 503/1011] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:35:54 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 1226 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:35:55.729708 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6710f40b-b9ad-4f0e-af42-46836830c655 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:35:55.730460 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6710f40b-b9ad-4f0e-af42-46836830c655 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 92432aae-7fac-49c2-a428-788d808b0a02] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:35:55.738018 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6710f40b-b9ad-4f0e-af42-46836830c655 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:55.738525 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6710f40b-b9ad-4f0e-af42-46836830c655 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:55.739310 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6710f40b-b9ad-4f0e-af42-46836830c655 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:55.739752 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6710f40b-b9ad-4f0e-af42-46836830c655 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:55.754623 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-6710f40b-b9ad-4f0e-af42-46836830c655 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] HTTP exception thrown: Instance 92432aae-7fac-49c2-a428-788d808b0a02 could not be found. May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6710f40b-b9ad-4f0e-af42-46836830c655 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Request method failure captured: May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 HTTP/1.1 May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-Lw_qPeOb0AIk6o9WPUMrO2DsXPuhWMCZKOnVq_1TjSgjvp0Yfw1IYLf11TFCXcNvHO5sAF5zAPqLpGHdyyyx5KoZBjXZsznDl8hNi5ZA7Np9Ru-2vznMd0cN643jpbgosd2W5hqhHfaW7d2SV3TgvRhBbO3x9JlB6qAoYy1tTM5f4 May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: 772b1948bd9546669688fe60a8c9ba46 May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-TestVolumeBootPattern-204955540 May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:35:55.757296 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:35:55.759115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:35:55.759115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-TestVolumeBootPattern-204955540 May 26 20:35:55.759115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: 772b1948bd9546669688fe60a8c9ba46 May 26 20:35:55.759115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-TestVolumeBootPattern-204955540 May 26 20:35:55.759115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-TestVolumeBootPattern-204955540-project May 26 20:35:55.759115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:35:55.759115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:35:55.759115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: 9558a9c3df27494d990d3b19f560b4d1 May 26 20:35:55.759115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-TestVolumeBootPattern-204955540-project May 26 20:35:55.759115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:35:55.759115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 92432aae-7fac-49c2-a428-788d808b0a02 could not be found. May 26 20:35:55.759115 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '92432aae-7fac-49c2-a428-788d808b0a02'} May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92432aae-7fac-49c2-a428-788d808b0a02 could not be found. May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:35:55.760157 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92432aae-7fac-49c2-a428-788d808b0a02 could not be found. May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92432aae-7fac-49c2-a428-788d808b0a02 could not be found. May 26 20:35:55.761864 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:35:55.763306 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6710f40b-b9ad-4f0e-af42-46836830c655 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Returning 404 to user: Instance 92432aae-7fac-49c2-a428-788d808b0a02 could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:35:55.763306 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6710f40b-b9ad-4f0e-af42-46836830c655 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02" status: 404 len: 111 microversion: 2.1 time: 0.034513 May 26 20:35:55.763306 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 509/1012] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:35:55 2022] GET /compute/v2.1/servers/92432aae-7fac-49c2-a428-788d808b0a02 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:35:59.778324 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-031cce97-889f-4b94-a708-48b91c04bc33 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:35:59.779947 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-031cce97-889f-4b94-a708-48b91c04bc33 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:35:59.787573 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-f5f5fca0-77d7-4b57-ac4f-75879e650568 req-da2decb9-c689-4504-a25e-d1695647ba09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "284492ec-a86d-403a-9bcf-5d02371fad81", "tag": "7aaed27d-d688-4e79-89e9-fc2f3fa5bf3f"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:35:59.806933 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-f5f5fca0-77d7-4b57-ac4f-75879e650568 req-da2decb9-c689-4504-a25e-d1695647ba09 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:59.807615 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-f5f5fca0-77d7-4b57-ac4f-75879e650568 req-da2decb9-c689-4504-a25e-d1695647ba09 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:59.813093 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-031cce97-889f-4b94-a708-48b91c04bc33 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:59.820085 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-031cce97-889f-4b94-a708-48b91c04bc33 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:59.820085 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-031cce97-889f-4b94-a708-48b91c04bc33 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:35:59.820085 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-031cce97-889f-4b94-a708-48b91c04bc33 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:35:59.840423 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-f5f5fca0-77d7-4b57-ac4f-75879e650568 req-da2decb9-c689-4504-a25e-d1695647ba09 service nova] Creating event network-changed:7aaed27d-d688-4e79-89e9-fc2f3fa5bf3f for instance 284492ec-a86d-403a-9bcf-5d02371fad81 on hv-cinder-84213 May 26 20:35:59.845686 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-f5f5fca0-77d7-4b57-ac4f-75879e650568 req-da2decb9-c689-4504-a25e-d1695647ba09 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061960 May 26 20:35:59.846629 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 510/1013] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 20:35:59.884137 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-031cce97-889f-4b94-a708-48b91c04bc33 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Going to try to terminate instance {{(pid=118307) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:36:00.293512 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-031cce97-889f-4b94-a708-48b91c04bc33 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "DELETE /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 204 len: 0 microversion: 2.1 time: 0.523627 May 26 20:36:00.297244 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 504/1014] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:35:59 2022] DELETE /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:36:00.304822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-780d2149-0460-4cb8-89f1-e0eddb4001a6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:00.305529 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-780d2149-0460-4cb8-89f1-e0eddb4001a6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:00.340681 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-780d2149-0460-4cb8-89f1-e0eddb4001a6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:00.341130 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-780d2149-0460-4cb8-89f1-e0eddb4001a6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:00.342286 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-780d2149-0460-4cb8-89f1-e0eddb4001a6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:00.342891 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-780d2149-0460-4cb8-89f1-e0eddb4001a6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:00.605444 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-780d2149-0460-4cb8-89f1-e0eddb4001a6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:00.614370 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-780d2149-0460-4cb8-89f1-e0eddb4001a6 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1578 microversion: 2.1 time: 0.315305 May 26 20:36:00.616040 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 511/1015] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:00 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1578 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:01.634358 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-8a87cf84-16b6-4633-9cb9-21f1d45696e2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:01.635357 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-8a87cf84-16b6-4633-9cb9-21f1d45696e2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:01.642899 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8a87cf84-16b6-4633-9cb9-21f1d45696e2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:01.643528 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8a87cf84-16b6-4633-9cb9-21f1d45696e2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:01.644417 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8a87cf84-16b6-4633-9cb9-21f1d45696e2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:01.644961 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-8a87cf84-16b6-4633-9cb9-21f1d45696e2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:02.041820 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-8a87cf84-16b6-4633-9cb9-21f1d45696e2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:02.056839 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-8a87cf84-16b6-4633-9cb9-21f1d45696e2 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1578 microversion: 2.1 time: 0.427413 May 26 20:36:02.072905 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 505/1016] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:01 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1578 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:02.488967 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-ba054e61-d3e5-4e0b-90d6-5698d8033774 req-ad262db5-884a-4f6f-ad1b-34ac15ed79fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284492ec-a86d-403a-9bcf-5d02371fad81", "name": "network-vif-deleted", "tag": "7aaed27d-d688-4e79-89e9-fc2f3fa5bf3f"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:36:02.498276 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-ba054e61-d3e5-4e0b-90d6-5698d8033774 req-ad262db5-884a-4f6f-ad1b-34ac15ed79fa service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:02.498874 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-ba054e61-d3e5-4e0b-90d6-5698d8033774 req-ad262db5-884a-4f6f-ad1b-34ac15ed79fa service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:02.513515 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-ba054e61-d3e5-4e0b-90d6-5698d8033774 req-ad262db5-884a-4f6f-ad1b-34ac15ed79fa service nova] Creating event network-vif-deleted:7aaed27d-d688-4e79-89e9-fc2f3fa5bf3f for instance 284492ec-a86d-403a-9bcf-5d02371fad81 on hv-cinder-84213 May 26 20:36:02.519034 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-ba054e61-d3e5-4e0b-90d6-5698d8033774 req-ad262db5-884a-4f6f-ad1b-34ac15ed79fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034334 May 26 20:36:02.520040 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 512/1017] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:36:03.081225 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-df131232-8c43-4bfd-8bc6-5b06a76d05e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:03.083254 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-df131232-8c43-4bfd-8bc6-5b06a76d05e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:03.089890 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df131232-8c43-4bfd-8bc6-5b06a76d05e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:03.090598 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df131232-8c43-4bfd-8bc6-5b06a76d05e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:03.091379 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df131232-8c43-4bfd-8bc6-5b06a76d05e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:03.091819 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df131232-8c43-4bfd-8bc6-5b06a76d05e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:03.131346 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df131232-8c43-4bfd-8bc6-5b06a76d05e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:03.132374 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-df131232-8c43-4bfd-8bc6-5b06a76d05e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:03.133162 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-df131232-8c43-4bfd-8bc6-5b06a76d05e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lazy-loading 'fault' on Instance uuid 284492ec-a86d-403a-9bcf-5d02371fad81 {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:36:03.181725 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-df131232-8c43-4bfd-8bc6-5b06a76d05e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9558a9c3df27494d990d3b19f560b4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772b1948bd9546669688fe60a8c9ba46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:03.194629 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-df131232-8c43-4bfd-8bc6-5b06a76d05e4 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 200 len: 1231 microversion: 2.1 time: 0.117527 May 26 20:36:03.195504 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 506/1018] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:03 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 1231 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:04.123600 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-74dd8901-2189-416f-861e-6a1746d97266 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Action: 'create', calling method: .version_select at 0x7f2da460a8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1565279704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNaUpevn7nq7VeAwjzZnupquyaCn1PoL2k+JHY0nzOfKyJQu6TZ74hjJP6ajlhqr1y2dZsJC6NL+6uFyjg2LszvYX5Sj7BjvT+aVZAd0MuTjKBTsZpYPebj61om56oWog=="}} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:36:04.138536 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-74dd8901-2189-416f-861e-6a1746d97266 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Getting quotas for project 2c995ba5f3954414839ae62d24643053. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:36:04.142691 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.quota [None req-74dd8901-2189-416f-861e-6a1746d97266 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Getting quotas for user de5cf400b3c949889f374fad17846f2b and project 2c995ba5f3954414839ae62d24643053. Resources: {'key_pairs'} {{(pid=118306) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:36:04.213038 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7359eeb6-7619-4ee0-a15e-56e3dfee8299 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:04.213593 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7359eeb6-7619-4ee0-a15e-56e3dfee8299 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 284492ec-a86d-403a-9bcf-5d02371fad81] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:04.220457 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7359eeb6-7619-4ee0-a15e-56e3dfee8299 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:04.220919 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7359eeb6-7619-4ee0-a15e-56e3dfee8299 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:04.221708 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7359eeb6-7619-4ee0-a15e-56e3dfee8299 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:04.222154 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7359eeb6-7619-4ee0-a15e-56e3dfee8299 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:04.232683 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-74dd8901-2189-416f-861e-6a1746d97266 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.279333 May 26 20:36:04.238653 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-7359eeb6-7619-4ee0-a15e-56e3dfee8299 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] HTTP exception thrown: Instance 284492ec-a86d-403a-9bcf-5d02371fad81 could not be found. May 26 20:36:04.243684 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 513/1019] 10.222.0.44 () {60 vars in 1158 bytes} [Thu May 26 20:36:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7359eeb6-7619-4ee0-a15e-56e3dfee8299 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Request method failure captured: May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 HTTP/1.1 May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-Lw_qPeOb0AIk6o9WPUMrO2DsXPuhWMCZKOnVq_1TjSgjvp0Yfw1IYLf11TFCXcNvHO5sAF5zAPqLpGHdyyyx5KoZBjXZsznDl8hNi5ZA7Np9Ru-2vznMd0cN643jpbgosd2W5hqhHfaW7d2SV3TgvRhBbO3x9JlB6qAoYy1tTM5f4 May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 772b1948bd9546669688fe60a8c9ba46 May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-TestVolumeBootPattern-204955540 May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:36:04.243835 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:36:04.245516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:36:04.245516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-TestVolumeBootPattern-204955540 May 26 20:36:04.245516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 772b1948bd9546669688fe60a8c9ba46 May 26 20:36:04.245516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-TestVolumeBootPattern-204955540 May 26 20:36:04.245516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-TestVolumeBootPattern-204955540-project May 26 20:36:04.245516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:36:04.245516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:36:04.245516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 9558a9c3df27494d990d3b19f560b4d1 May 26 20:36:04.245516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-TestVolumeBootPattern-204955540-project May 26 20:36:04.245516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:36:04.245516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 284492ec-a86d-403a-9bcf-5d02371fad81 could not be found. May 26 20:36:04.245516 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '284492ec-a86d-403a-9bcf-5d02371fad81'} May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 284492ec-a86d-403a-9bcf-5d02371fad81 could not be found. May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:36:04.246592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 284492ec-a86d-403a-9bcf-5d02371fad81 could not be found. May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 284492ec-a86d-403a-9bcf-5d02371fad81 could not be found. May 26 20:36:04.248131 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:36:04.250127 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7359eeb6-7619-4ee0-a15e-56e3dfee8299 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Returning 404 to user: Instance 284492ec-a86d-403a-9bcf-5d02371fad81 could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:36:04.250127 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7359eeb6-7619-4ee0-a15e-56e3dfee8299 tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81" status: 404 len: 111 microversion: 2.1 time: 0.034601 May 26 20:36:04.250127 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 507/1020] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:04 2022] GET /compute/v2.1/servers/284492ec-a86d-403a-9bcf-5d02371fad81 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:36:04.867950 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7afc4498-9008-4f12-bc1f-09f64cb7a20d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:04.868688 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-7afc4498-9008-4f12-bc1f-09f64cb7a20d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:04.875064 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7afc4498-9008-4f12-bc1f-09f64cb7a20d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:04.875514 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7afc4498-9008-4f12-bc1f-09f64cb7a20d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:04.876287 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7afc4498-9008-4f12-bc1f-09f64cb7a20d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:04.876723 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-7afc4498-9008-4f12-bc1f-09f64cb7a20d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:04.891122 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-7afc4498-9008-4f12-bc1f-09f64cb7a20d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] HTTP exception thrown: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7afc4498-9008-4f12-bc1f-09f64cb7a20d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Request method failure captured: May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: DELETE /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d HTTP/1.1 May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-Lw_qPeOb0AIk6o9WPUMrO2DsXPuhWMCZKOnVq_1TjSgjvp0Yfw1IYLf11TFCXcNvHO5sAF5zAPqLpGHdyyyx5KoZBjXZsznDl8hNi5ZA7Np9Ru-2vznMd0cN643jpbgosd2W5hqhHfaW7d2SV3TgvRhBbO3x9JlB6qAoYy1tTM5f4 May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: 772b1948bd9546669688fe60a8c9ba46 May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-TestVolumeBootPattern-204955540 May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:36:04.896354 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:36:04.898145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:36:04.898145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-TestVolumeBootPattern-204955540 May 26 20:36:04.898145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: 772b1948bd9546669688fe60a8c9ba46 May 26 20:36:04.898145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-TestVolumeBootPattern-204955540 May 26 20:36:04.898145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-TestVolumeBootPattern-204955540-project May 26 20:36:04.898145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:36:04.898145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:36:04.898145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: 9558a9c3df27494d990d3b19f560b4d1 May 26 20:36:04.898145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-TestVolumeBootPattern-204955540-project May 26 20:36:04.898145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:36:04.898145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:36:04.898145 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '39113a21-669c-497d-9364-469eec53967d'} May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:36:04.899156 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:36:04.900710 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:36:04.902236 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-7afc4498-9008-4f12-bc1f-09f64cb7a20d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Returning 404 to user: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:36:04.902236 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-7afc4498-9008-4f12-bc1f-09f64cb7a20d tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "DELETE /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 404 len: 111 microversion: 2.1 time: 0.030694 May 26 20:36:04.902236 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 514/1021] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:36:04 2022] DELETE /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:36:04.903655 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f81994f4-e6e7-43f9-bc44-dec1e7efb0ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:04.904455 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f81994f4-e6e7-43f9-bc44-dec1e7efb0ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] [instance: 39113a21-669c-497d-9364-469eec53967d] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:04.915327 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f81994f4-e6e7-43f9-bc44-dec1e7efb0ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:04.915776 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f81994f4-e6e7-43f9-bc44-dec1e7efb0ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:04.916568 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f81994f4-e6e7-43f9-bc44-dec1e7efb0ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:04.923107 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f81994f4-e6e7-43f9-bc44-dec1e7efb0ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:04.940719 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.wsgi [None req-f81994f4-e6e7-43f9-bc44-dec1e7efb0ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] HTTP exception thrown: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f81994f4-e6e7-43f9-bc44-dec1e7efb0ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Request method failure captured: May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: request: GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d HTTP/1.1 May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept: application/json May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Accept-Encoding: identity May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Connection: close May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Length: 0 May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Content-Type: application/json May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Host: 10.222.0.44 May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Openstack-System-Scope: None May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: User-Agent: python-urllib3/1.26.9 May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Auth-Token: gAAAAABij-Lw_qPeOb0AIk6o9WPUMrO2DsXPuhWMCZKOnVq_1TjSgjvp0Yfw1IYLf11TFCXcNvHO5sAF5zAPqLpGHdyyyx5KoZBjXZsznDl8hNi5ZA7Np9Ru-2vznMd0cN643jpbgosd2W5hqhHfaW7d2SV3TgvRhBbO3x9JlB6qAoYy1tTM5f4 May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Id: None May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Domain-Name: None May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Identity-Status: Confirmed May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Is-Admin-Project: True May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Id: default May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Domain-Name: Default May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Id: 772b1948bd9546669688fe60a8c9ba46 May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Project-Name: tempest-TestVolumeBootPattern-204955540 May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Role: reader,member May 26 20:36:04.942430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Roles: reader,member May 26 20:36:04.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/772b1948bd9546669688fe60a8c9ba46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:36:04.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant: tempest-TestVolumeBootPattern-204955540 May 26 20:36:04.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Id: 772b1948bd9546669688fe60a8c9ba46 May 26 20:36:04.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-Tenant-Name: tempest-TestVolumeBootPattern-204955540 May 26 20:36:04.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User: tempest-TestVolumeBootPattern-204955540-project May 26 20:36:04.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Id: default May 26 20:36:04.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Domain-Name: Default May 26 20:36:04.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Id: 9558a9c3df27494d990d3b19f560b4d1 May 26 20:36:04.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: X-User-Name: tempest-TestVolumeBootPattern-204955540-project May 26 20:36:04.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: method: > May 26 20:36:04.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: exception: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:36:04.944713 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: action_args: {'id': '39113a21-669c-497d-9364-469eec53967d'} May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:36:04.946505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. May 26 20:36:04.948758 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR nova.api.openstack.wsgi May 26 20:36:04.950147 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f81994f4-e6e7-43f9-bc44-dec1e7efb0ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Returning 404 to user: Instance 39113a21-669c-497d-9364-469eec53967d could not be found. {{(pid=118307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:36:04.950147 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f81994f4-e6e7-43f9-bc44-dec1e7efb0ac tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d" status: 404 len: 111 microversion: 2.1 time: 0.044112 May 26 20:36:04.950147 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 508/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:04 2022] GET /compute/v2.1/servers/39113a21-669c-497d-9364-469eec53967d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:36:06.476026 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0a353d88-5707-4a37-9e9a-1c8cde94ebbe tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] Calling method '.version_select at 0x7f2da46b8820>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:06.574027 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0a353d88-5707-4a37-9e9a-1c8cde94ebbe tempest-TestVolumeBootPattern-204955540 tempest-TestVolumeBootPattern-204955540-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1889197979" status: 202 len: 0 microversion: 2.1 time: 0.103384 May 26 20:36:06.575142 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 515/1023] 10.222.0.44 () {58 vars in 1262 bytes} [Thu May 26 20:36:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1889197979 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:36:22.490606 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1634387648", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1565279704", "security_groups": [{"name": "tempest-secgroup-smoke-243246147"}], "networks": [{"uuid": "8b878ec8-9ac0-4995-a521-abdc0b4ce8f9"}], "block_device_mapping_v2": [{"uuid": "b1505519-0055-497e-af39-7d53225bd2e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:36:22.499823 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:36:22.500800 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:36:22.603987 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.network.neutron [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] validate_networks() for [('8b878ec8-9ac0-4995-a521-abdc0b4ce8f9', None, None, None, None, None)] {{(pid=118307) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 20:36:23.135264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Flavor limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 20:36:23.135684 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Image limits 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 20:36:23.136153 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Flavor pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 20:36:23.136563 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Image pref 0:0:0 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 20:36:23.136969 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.virt.hardware [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 20:36:23.145607 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:23.146051 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:23.146884 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:23.147330 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:23.165900 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Getting quotas for project 2c995ba5f3954414839ae62d24643053. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 20:36:23.169811 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.quota [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Getting quotas for user de5cf400b3c949889f374fad17846f2b and project 2c995ba5f3954414839ae62d24643053. Resources: {'instances', 'ram', 'cores'} {{(pid=118307) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 20:36:23.226663 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Going to run 1 instances... {{(pid=118307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 20:36:23.228761 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1505519-0055-497e-af39-7d53225bd2e0',volume_size=None,volume_type=None)] {{(pid=118307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 20:36:23.603016 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c324c90c-4a24-43da-aca6-515271dd30ee tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.116651 May 26 20:36:23.603696 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 509/1024] 10.222.0.44 () {60 vars in 1146 bytes} [Thu May 26 20:36:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 20:36:23.611681 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=4 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:36:23.612430 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=24 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:36:23.613098 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:36:23.618085 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8e48a399-bb3c-4095-a074-5ebe4e4ac23a tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:23.618733 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8e48a399-bb3c-4095-a074-5ebe4e4ac23a tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:23.674184 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8e48a399-bb3c-4095-a074-5ebe4e4ac23a tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:23.681742 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8e48a399-bb3c-4095-a074-5ebe4e4ac23a tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1089 microversion: 2.1 time: 0.071454 May 26 20:36:23.682327 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 516/1025] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:23 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:36:24.699712 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ca471bb6-a141-46ad-a87a-5b5a266a3d59 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:24.700314 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ca471bb6-a141-46ad-a87a-5b5a266a3d59 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:24.706527 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ca471bb6-a141-46ad-a87a-5b5a266a3d59 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:24.707026 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ca471bb6-a141-46ad-a87a-5b5a266a3d59 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:24.707789 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ca471bb6-a141-46ad-a87a-5b5a266a3d59 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:24.708226 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ca471bb6-a141-46ad-a87a-5b5a266a3d59 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:24.771166 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ca471bb6-a141-46ad-a87a-5b5a266a3d59 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:24.786735 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ca471bb6-a141-46ad-a87a-5b5a266a3d59 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1139 microversion: 2.1 time: 0.092010 May 26 20:36:24.787322 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 510/1026] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:24 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:25.805309 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-704705fa-bdfa-4504-a0f1-fb54aa097375 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:25.805926 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-704705fa-bdfa-4504-a0f1-fb54aa097375 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:25.814968 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-704705fa-bdfa-4504-a0f1-fb54aa097375 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:25.814968 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-704705fa-bdfa-4504-a0f1-fb54aa097375 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:25.814968 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-704705fa-bdfa-4504-a0f1-fb54aa097375 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:25.815314 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-704705fa-bdfa-4504-a0f1-fb54aa097375 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:25.887765 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-704705fa-bdfa-4504-a0f1-fb54aa097375 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:25.895312 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-704705fa-bdfa-4504-a0f1-fb54aa097375 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1195 microversion: 2.1 time: 0.094480 May 26 20:36:25.895911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 517/1027] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:25 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1195 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:26.912712 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-90e0bcb0-09a5-4fb7-b612-c89943f5c314 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:26.913545 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-90e0bcb0-09a5-4fb7-b612-c89943f5c314 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:26.927689 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-90e0bcb0-09a5-4fb7-b612-c89943f5c314 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:26.928160 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-90e0bcb0-09a5-4fb7-b612-c89943f5c314 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:26.928927 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-90e0bcb0-09a5-4fb7-b612-c89943f5c314 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:26.929603 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-90e0bcb0-09a5-4fb7-b612-c89943f5c314 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:27.139801 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-90e0bcb0-09a5-4fb7-b612-c89943f5c314 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:27.147423 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-90e0bcb0-09a5-4fb7-b612-c89943f5c314 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1272 microversion: 2.1 time: 0.238667 May 26 20:36:27.148289 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 511/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:26 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:27.292509 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-e6d082e9-d86b-4fd2-90f5-24520f812240 req-e1d782e0-b99f-4184-96d6-20af29731210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e15353-2394-418f-923f-5122a70e7b5c", "tag": "ea03b263-e8b3-4f50-9c7b-b6a26b329071"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:36:27.305550 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-e6d082e9-d86b-4fd2-90f5-24520f812240 req-e1d782e0-b99f-4184-96d6-20af29731210 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:27.306206 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-e6d082e9-d86b-4fd2-90f5-24520f812240 req-e1d782e0-b99f-4184-96d6-20af29731210 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:27.320677 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-e6d082e9-d86b-4fd2-90f5-24520f812240 req-e1d782e0-b99f-4184-96d6-20af29731210 service nova] Creating event network-changed:ea03b263-e8b3-4f50-9c7b-b6a26b329071 for instance 44e15353-2394-418f-923f-5122a70e7b5c on hv-cinder-84213 May 26 20:36:27.326077 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-e6d082e9-d86b-4fd2-90f5-24520f812240 req-e1d782e0-b99f-4184-96d6-20af29731210 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037684 May 26 20:36:27.326969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 518/1029] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:36:28.165098 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-ae038373-cc60-4073-90e4-fea5968d6f09 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:28.165695 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-ae038373-cc60-4073-90e4-fea5968d6f09 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:28.172278 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae038373-cc60-4073-90e4-fea5968d6f09 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:28.172725 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae038373-cc60-4073-90e4-fea5968d6f09 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:28.173490 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae038373-cc60-4073-90e4-fea5968d6f09 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:28.173922 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-ae038373-cc60-4073-90e4-fea5968d6f09 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:28.367643 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-ae038373-cc60-4073-90e4-fea5968d6f09 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:28.375251 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-ae038373-cc60-4073-90e4-fea5968d6f09 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1260 microversion: 2.1 time: 0.214121 May 26 20:36:28.375815 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 512/1030] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:28 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:29.393251 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-ed57151a-2760-4138-be0c-809c93da86d0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:29.393896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-ed57151a-2760-4138-be0c-809c93da86d0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:29.401581 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ed57151a-2760-4138-be0c-809c93da86d0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:29.402030 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ed57151a-2760-4138-be0c-809c93da86d0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:29.402827 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ed57151a-2760-4138-be0c-809c93da86d0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:29.403260 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-ed57151a-2760-4138-be0c-809c93da86d0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:29.542098 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-ed57151a-2760-4138-be0c-809c93da86d0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:29.551378 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-ed57151a-2760-4138-be0c-809c93da86d0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1260 microversion: 2.1 time: 0.162415 May 26 20:36:29.551983 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 519/1031] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:29 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:30.568002 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-11018729-86c8-48d9-98e3-99ec31b90e1c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:30.568550 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-11018729-86c8-48d9-98e3-99ec31b90e1c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:30.576141 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-11018729-86c8-48d9-98e3-99ec31b90e1c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:30.576592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-11018729-86c8-48d9-98e3-99ec31b90e1c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:30.577414 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-11018729-86c8-48d9-98e3-99ec31b90e1c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:30.577853 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-11018729-86c8-48d9-98e3-99ec31b90e1c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:30.704192 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-11018729-86c8-48d9-98e3-99ec31b90e1c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:30.712478 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-11018729-86c8-48d9-98e3-99ec31b90e1c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1260 microversion: 2.1 time: 0.148410 May 26 20:36:30.713044 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 513/1032] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:30 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:31.729828 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-f59ecbfe-bc62-4616-90a8-fe66cae7d8cf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:31.730439 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-f59ecbfe-bc62-4616-90a8-fe66cae7d8cf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:31.736875 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f59ecbfe-bc62-4616-90a8-fe66cae7d8cf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:31.737319 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f59ecbfe-bc62-4616-90a8-fe66cae7d8cf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:31.738067 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f59ecbfe-bc62-4616-90a8-fe66cae7d8cf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:31.738523 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f59ecbfe-bc62-4616-90a8-fe66cae7d8cf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:31.883845 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-f59ecbfe-bc62-4616-90a8-fe66cae7d8cf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:31.891334 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-f59ecbfe-bc62-4616-90a8-fe66cae7d8cf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1260 microversion: 2.1 time: 0.166148 May 26 20:36:31.892904 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 520/1033] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:31 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:32.908273 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-7656b361-57e1-4e0d-be4a-994ab3fbaede tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:32.908815 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-7656b361-57e1-4e0d-be4a-994ab3fbaede tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:32.915548 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7656b361-57e1-4e0d-be4a-994ab3fbaede tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:32.915998 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7656b361-57e1-4e0d-be4a-994ab3fbaede tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:32.916772 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7656b361-57e1-4e0d-be4a-994ab3fbaede tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:32.917211 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-7656b361-57e1-4e0d-be4a-994ab3fbaede tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:33.049801 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-7656b361-57e1-4e0d-be4a-994ab3fbaede tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:33.057494 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-7656b361-57e1-4e0d-be4a-994ab3fbaede tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1260 microversion: 2.1 time: 0.153218 May 26 20:36:33.067261 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 514/1034] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:32 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:34.074431 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-61826264-87b0-4121-9221-3c04ad4ea655 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:34.075047 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-61826264-87b0-4121-9221-3c04ad4ea655 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:34.077515 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell0:SELECT=2 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:36:34.082395 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61826264-87b0-4121-9221-3c04ad4ea655 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:34.082847 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61826264-87b0-4121-9221-3c04ad4ea655 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:34.083642 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61826264-87b0-4121-9221-3c04ad4ea655 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:34.084334 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-61826264-87b0-4121-9221-3c04ad4ea655 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:34.224494 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-61826264-87b0-4121-9221-3c04ad4ea655 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:34.233311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-61826264-87b0-4121-9221-3c04ad4ea655 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1260 microversion: 2.1 time: 0.163365 May 26 20:36:34.234082 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 521/1035] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:34 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:35.250263 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-1065c821-bd4c-49fc-b3ea-8586c0f1f44d tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:35.250896 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-1065c821-bd4c-49fc-b3ea-8586c0f1f44d tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:35.252702 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:36:35.253354 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell0:SELECT=6 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:36:35.259168 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1065c821-bd4c-49fc-b3ea-8586c0f1f44d tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:35.261369 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1065c821-bd4c-49fc-b3ea-8586c0f1f44d tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:35.261369 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1065c821-bd4c-49fc-b3ea-8586c0f1f44d tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:35.261369 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-1065c821-bd4c-49fc-b3ea-8586c0f1f44d tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:35.395485 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-1065c821-bd4c-49fc-b3ea-8586c0f1f44d tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:35.403633 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-1065c821-bd4c-49fc-b3ea-8586c0f1f44d tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1260 microversion: 2.1 time: 0.157404 May 26 20:36:35.404207 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 515/1036] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:35 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:36.421317 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-f609f39d-6731-4aaf-be66-8b9583d27855 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:36.421916 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-f609f39d-6731-4aaf-be66-8b9583d27855 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:36.428357 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f609f39d-6731-4aaf-be66-8b9583d27855 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:36.428800 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f609f39d-6731-4aaf-be66-8b9583d27855 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:36.429557 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f609f39d-6731-4aaf-be66-8b9583d27855 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:36.429995 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f609f39d-6731-4aaf-be66-8b9583d27855 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:36.564056 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-f609f39d-6731-4aaf-be66-8b9583d27855 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:36.571465 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-f609f39d-6731-4aaf-be66-8b9583d27855 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1260 microversion: 2.1 time: 0.155030 May 26 20:36:36.572039 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 522/1037] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:36 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:37.589155 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-65419919-8a67-4c15-bad4-25781090d74e tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:37.589823 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-65419919-8a67-4c15-bad4-25781090d74e tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:37.596470 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-65419919-8a67-4c15-bad4-25781090d74e tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:37.596919 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-65419919-8a67-4c15-bad4-25781090d74e tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:37.597695 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-65419919-8a67-4c15-bad4-25781090d74e tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:37.598128 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-65419919-8a67-4c15-bad4-25781090d74e tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:37.618236 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-0135c782-aaf2-4972-8f16-629855baf677 req-1146642c-3eb6-40b3-89a1-1abf9507b579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e15353-2394-418f-923f-5122a70e7b5c", "name": "network-vif-plugged", "status": "completed", "tag": "ea03b263-e8b3-4f50-9c7b-b6a26b329071"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:36:37.627349 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-0135c782-aaf2-4972-8f16-629855baf677 req-1146642c-3eb6-40b3-89a1-1abf9507b579 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:37.629660 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-0135c782-aaf2-4972-8f16-629855baf677 req-1146642c-3eb6-40b3-89a1-1abf9507b579 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:37.639330 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-0135c782-aaf2-4972-8f16-629855baf677 req-1146642c-3eb6-40b3-89a1-1abf9507b579 service nova] Creating event network-vif-plugged:ea03b263-e8b3-4f50-9c7b-b6a26b329071 for instance 44e15353-2394-418f-923f-5122a70e7b5c on hv-cinder-84213 May 26 20:36:37.647003 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-0135c782-aaf2-4972-8f16-629855baf677 req-1146642c-3eb6-40b3-89a1-1abf9507b579 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169419 May 26 20:36:37.647604 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 516/1038] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:36:37.741553 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-65419919-8a67-4c15-bad4-25781090d74e tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:37.749475 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-65419919-8a67-4c15-bad4-25781090d74e tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1260 microversion: 2.1 time: 0.164300 May 26 20:36:37.750740 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 523/1039] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:37 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:36:38.767668 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-81c8af26-75e5-44e4-b1ce-60ed6b8f6b22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:38.768448 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-81c8af26-75e5-44e4-b1ce-60ed6b8f6b22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:38.774686 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-81c8af26-75e5-44e4-b1ce-60ed6b8f6b22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:38.775135 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-81c8af26-75e5-44e4-b1ce-60ed6b8f6b22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:38.776081 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-81c8af26-75e5-44e4-b1ce-60ed6b8f6b22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:38.776640 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-81c8af26-75e5-44e4-b1ce-60ed6b8f6b22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:38.908321 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-81c8af26-75e5-44e4-b1ce-60ed6b8f6b22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:38.915929 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-81c8af26-75e5-44e4-b1ce-60ed6b8f6b22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1260 microversion: 2.1 time: 0.152924 May 26 20:36:38.917197 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 517/1040] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:38 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:39.934116 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-6f6301d6-5b90-4625-8ddb-c17cbae3bf89 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:39.934756 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-6f6301d6-5b90-4625-8ddb-c17cbae3bf89 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:39.941176 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6f6301d6-5b90-4625-8ddb-c17cbae3bf89 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:39.941627 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6f6301d6-5b90-4625-8ddb-c17cbae3bf89 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:39.942413 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6f6301d6-5b90-4625-8ddb-c17cbae3bf89 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:39.942841 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-6f6301d6-5b90-4625-8ddb-c17cbae3bf89 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:40.072069 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-6f6301d6-5b90-4625-8ddb-c17cbae3bf89 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:40.080352 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-6f6301d6-5b90-4625-8ddb-c17cbae3bf89 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1444 microversion: 2.1 time: 0.151003 May 26 20:36:40.080927 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 524/1041] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:39 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:40.096765 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-c837e4e7-4f32-404c-9884-e3d309757e6c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:36:40.097379 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-c837e4e7-4f32-404c-9884-e3d309757e6c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:36:40.103878 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c837e4e7-4f32-404c-9884-e3d309757e6c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:40.104351 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c837e4e7-4f32-404c-9884-e3d309757e6c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:40.105107 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c837e4e7-4f32-404c-9884-e3d309757e6c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:40.105550 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-c837e4e7-4f32-404c-9884-e3d309757e6c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:40.240924 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-c837e4e7-4f32-404c-9884-e3d309757e6c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:36:40.249053 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-c837e4e7-4f32-404c-9884-e3d309757e6c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1444 microversion: 2.1 time: 0.156141 May 26 20:36:40.249626 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 518/1042] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:36:40 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:36:42.229989 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [req-0a21d74f-3e7a-4052-86f8-beceefa726ae req-71b9cc8a-a2c6-4616-bc23-d6b076ac4a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e15353-2394-418f-923f-5122a70e7b5c", "tag": "ea03b263-e8b3-4f50-9c7b-b6a26b329071"}]} {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:36:42.238774 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-0a21d74f-3e7a-4052-86f8-beceefa726ae req-71b9cc8a-a2c6-4616-bc23-d6b076ac4a80 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:36:42.239208 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [req-0a21d74f-3e7a-4052-86f8-beceefa726ae req-71b9cc8a-a2c6-4616-bc23-d6b076ac4a80 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:36:42.251688 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.compute.server_external_events [req-0a21d74f-3e7a-4052-86f8-beceefa726ae req-71b9cc8a-a2c6-4616-bc23-d6b076ac4a80 service nova] Creating event network-changed:ea03b263-e8b3-4f50-9c7b-b6a26b329071 for instance 44e15353-2394-418f-923f-5122a70e7b5c on hv-cinder-84213 May 26 20:36:42.256972 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [req-0a21d74f-3e7a-4052-86f8-beceefa726ae req-71b9cc8a-a2c6-4616-bc23-d6b076ac4a80 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031085 May 26 20:36:42.257912 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 525/1043] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:36:54.608578 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:36:54.609193 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Thu May 26 20:36:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:37:50.279136 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:37:50.279717 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Thu May 26 20:37:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:38:36.069820 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:38:36.070502 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Thu May 26 20:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:38:36.133913 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-bbdc6a40-b39a-48c6-b739-7874d112c046 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:38:36.134458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-bbdc6a40-b39a-48c6-b739-7874d112c046 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:36.137085 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: ERROR oslo.messaging._drivers.impl_rabbit [-] [beabc284-0a0e-4577-bd16-e8b4e67e00d0] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 26 20:38:36.137533 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:38:36.138173 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=52 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:38:36.143114 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bbdc6a40-b39a-48c6-b739-7874d112c046 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:36.143592 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bbdc6a40-b39a-48c6-b739-7874d112c046 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:36.144352 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bbdc6a40-b39a-48c6-b739-7874d112c046 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:36.144786 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-bbdc6a40-b39a-48c6-b739-7874d112c046 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:36.167790 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-bbdc6a40-b39a-48c6-b739-7874d112c046 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lazy-loading 'flavor' on Instance uuid 44e15353-2394-418f-923f-5122a70e7b5c {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:38:36.407209 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-bbdc6a40-b39a-48c6-b739-7874d112c046 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "POST /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.277443 May 26 20:38:36.412037 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 519/1044] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:38:36 2022] POST /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 20:38:36.414985 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9697dcf9-c1d6-4e28-b70b-2034294f0d0b] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 26 20:38:36.415620 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=22 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:38:36.416352 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=46 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:38:36.420523 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-8abc51a5-f3ea-47ef-b197-368e160ac3c6 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:36.421127 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-8abc51a5-f3ea-47ef-b197-368e160ac3c6 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:36.428675 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8abc51a5-f3ea-47ef-b197-368e160ac3c6 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:36.429198 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8abc51a5-f3ea-47ef-b197-368e160ac3c6 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:36.430012 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8abc51a5-f3ea-47ef-b197-368e160ac3c6 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:36.430476 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-8abc51a5-f3ea-47ef-b197-368e160ac3c6 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:36.649113 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-8abc51a5-f3ea-47ef-b197-368e160ac3c6 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:36.656586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-8abc51a5-f3ea-47ef-b197-368e160ac3c6 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.243873 May 26 20:38:36.657141 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 526/1045] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:36 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:37.675751 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-3e8fb852-a1e4-4a82-b388-1c4d5bd35481 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:37.676454 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-3e8fb852-a1e4-4a82-b388-1c4d5bd35481 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:37.683891 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e8fb852-a1e4-4a82-b388-1c4d5bd35481 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:37.684343 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e8fb852-a1e4-4a82-b388-1c4d5bd35481 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:37.685115 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e8fb852-a1e4-4a82-b388-1c4d5bd35481 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:37.685552 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-3e8fb852-a1e4-4a82-b388-1c4d5bd35481 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:37.689105 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] [beabc284-0a0e-4577-bd16-e8b4e67e00d0] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 55182. May 26 20:38:37.878970 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-3e8fb852-a1e4-4a82-b388-1c4d5bd35481 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:37.886424 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-3e8fb852-a1e4-4a82-b388-1c4d5bd35481 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.216033 May 26 20:38:37.887001 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 520/1046] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:37 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 20:38:38.904049 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-374b5995-a704-408d-b562-0079276f4cb7 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:38.904680 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-374b5995-a704-408d-b562-0079276f4cb7 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:38.915063 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO oslo.messaging._drivers.impl_rabbit [-] [9697dcf9-c1d6-4e28-b70b-2034294f0d0b] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 55188. May 26 20:38:38.919226 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-374b5995-a704-408d-b562-0079276f4cb7 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:38.919720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-374b5995-a704-408d-b562-0079276f4cb7 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:38.920484 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-374b5995-a704-408d-b562-0079276f4cb7 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:38.920912 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-374b5995-a704-408d-b562-0079276f4cb7 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:39.054222 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-374b5995-a704-408d-b562-0079276f4cb7 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:39.061846 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-374b5995-a704-408d-b562-0079276f4cb7 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.161686 May 26 20:38:39.062437 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 527/1047] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:38 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:40.079089 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-49d7e7e3-4d4f-4840-a9b9-fa86bbdccb22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:40.079699 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-49d7e7e3-4d4f-4840-a9b9-fa86bbdccb22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:40.086515 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49d7e7e3-4d4f-4840-a9b9-fa86bbdccb22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:40.086968 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49d7e7e3-4d4f-4840-a9b9-fa86bbdccb22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:40.087725 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49d7e7e3-4d4f-4840-a9b9-fa86bbdccb22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:40.088158 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-49d7e7e3-4d4f-4840-a9b9-fa86bbdccb22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:40.216686 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-49d7e7e3-4d4f-4840-a9b9-fa86bbdccb22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:40.224893 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-49d7e7e3-4d4f-4840-a9b9-fa86bbdccb22 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.149978 May 26 20:38:40.225453 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 521/1048] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:40 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:41.244833 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-dce5d942-1ee9-4c36-a5b0-6712abb396d4 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:41.245489 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-dce5d942-1ee9-4c36-a5b0-6712abb396d4 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:41.254281 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dce5d942-1ee9-4c36-a5b0-6712abb396d4 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:41.254734 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dce5d942-1ee9-4c36-a5b0-6712abb396d4 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:41.255709 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dce5d942-1ee9-4c36-a5b0-6712abb396d4 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:41.256223 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-dce5d942-1ee9-4c36-a5b0-6712abb396d4 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:41.384542 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-dce5d942-1ee9-4c36-a5b0-6712abb396d4 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:41.391969 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-dce5d942-1ee9-4c36-a5b0-6712abb396d4 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.153089 May 26 20:38:41.392533 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 528/1049] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:41 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:42.408822 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-20b44022-d02e-42e7-b0ee-9e4ef1270617 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:42.409934 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-20b44022-d02e-42e7-b0ee-9e4ef1270617 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:42.416450 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20b44022-d02e-42e7-b0ee-9e4ef1270617 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:42.416893 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20b44022-d02e-42e7-b0ee-9e4ef1270617 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:42.417648 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20b44022-d02e-42e7-b0ee-9e4ef1270617 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:42.418080 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-20b44022-d02e-42e7-b0ee-9e4ef1270617 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:42.547035 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-20b44022-d02e-42e7-b0ee-9e4ef1270617 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:42.555155 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-20b44022-d02e-42e7-b0ee-9e4ef1270617 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.150230 May 26 20:38:42.555716 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 522/1050] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:42 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:43.572785 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-77aea156-e6ba-4190-8891-dd566bc9ade8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:43.573387 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-77aea156-e6ba-4190-8891-dd566bc9ade8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:43.580015 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-77aea156-e6ba-4190-8891-dd566bc9ade8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:43.580455 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-77aea156-e6ba-4190-8891-dd566bc9ade8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:43.581505 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-77aea156-e6ba-4190-8891-dd566bc9ade8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:43.582193 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-77aea156-e6ba-4190-8891-dd566bc9ade8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:43.717130 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-77aea156-e6ba-4190-8891-dd566bc9ade8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:43.724662 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-77aea156-e6ba-4190-8891-dd566bc9ade8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.155871 May 26 20:38:43.725222 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 529/1051] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:43 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:44.741170 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-4ef44dd3-9f23-4df2-a550-f6afcd06a786 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:44.741933 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-4ef44dd3-9f23-4df2-a550-f6afcd06a786 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:44.748639 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4ef44dd3-9f23-4df2-a550-f6afcd06a786 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:44.749083 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4ef44dd3-9f23-4df2-a550-f6afcd06a786 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:44.749839 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4ef44dd3-9f23-4df2-a550-f6afcd06a786 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:44.750293 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-4ef44dd3-9f23-4df2-a550-f6afcd06a786 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:44.881297 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-4ef44dd3-9f23-4df2-a550-f6afcd06a786 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:44.889102 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-4ef44dd3-9f23-4df2-a550-f6afcd06a786 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.152130 May 26 20:38:44.889677 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 523/1052] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:44 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:45.645693 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:38:45.645881 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Thu May 26 20:38:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:38:45.906687 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-2f0f6454-2e57-4f2f-b676-448e0e7eb47c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:45.907213 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-2f0f6454-2e57-4f2f-b676-448e0e7eb47c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:45.914812 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2f0f6454-2e57-4f2f-b676-448e0e7eb47c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:45.915260 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2f0f6454-2e57-4f2f-b676-448e0e7eb47c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:45.916026 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2f0f6454-2e57-4f2f-b676-448e0e7eb47c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:45.916458 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-2f0f6454-2e57-4f2f-b676-448e0e7eb47c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:46.047197 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-2f0f6454-2e57-4f2f-b676-448e0e7eb47c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:46.054782 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-2f0f6454-2e57-4f2f-b676-448e0e7eb47c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.152144 May 26 20:38:46.055342 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 530/1053] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:45 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:47.072457 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d0f677f1-30da-4bb9-be2e-cb3ac76674a9 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:47.073021 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d0f677f1-30da-4bb9-be2e-cb3ac76674a9 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:47.080206 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0f677f1-30da-4bb9-be2e-cb3ac76674a9 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:47.080668 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0f677f1-30da-4bb9-be2e-cb3ac76674a9 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:47.082385 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0f677f1-30da-4bb9-be2e-cb3ac76674a9 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:47.082833 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d0f677f1-30da-4bb9-be2e-cb3ac76674a9 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:47.379028 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-d0f677f1-30da-4bb9-be2e-cb3ac76674a9 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:47.386670 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d0f677f1-30da-4bb9-be2e-cb3ac76674a9 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.318161 May 26 20:38:47.387239 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 524/1054] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:47 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:48.403506 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-46f7d1e0-b467-4aee-a6df-bc407ee0a1cd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:48.404263 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-46f7d1e0-b467-4aee-a6df-bc407ee0a1cd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:48.411008 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-46f7d1e0-b467-4aee-a6df-bc407ee0a1cd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:48.411451 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-46f7d1e0-b467-4aee-a6df-bc407ee0a1cd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:48.412200 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-46f7d1e0-b467-4aee-a6df-bc407ee0a1cd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:48.412631 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-46f7d1e0-b467-4aee-a6df-bc407ee0a1cd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:48.546872 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-46f7d1e0-b467-4aee-a6df-bc407ee0a1cd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:48.555137 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-46f7d1e0-b467-4aee-a6df-bc407ee0a1cd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.155403 May 26 20:38:48.555724 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 531/1055] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:48 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:49.573379 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-13bc5017-0ce7-4591-972d-076f8186e8f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:49.574425 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-13bc5017-0ce7-4591-972d-076f8186e8f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:49.584717 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13bc5017-0ce7-4591-972d-076f8186e8f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:49.585170 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13bc5017-0ce7-4591-972d-076f8186e8f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:49.585951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13bc5017-0ce7-4591-972d-076f8186e8f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:49.586425 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-13bc5017-0ce7-4591-972d-076f8186e8f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:49.718951 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-13bc5017-0ce7-4591-972d-076f8186e8f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:49.727896 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-13bc5017-0ce7-4591-972d-076f8186e8f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.159561 May 26 20:38:49.728457 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 525/1056] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:49 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:50.744905 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1c4485b0-5db0-472e-8451-00740d5f408c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:50.745510 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-1c4485b0-5db0-472e-8451-00740d5f408c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:50.752209 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1c4485b0-5db0-472e-8451-00740d5f408c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:50.752659 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1c4485b0-5db0-472e-8451-00740d5f408c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:50.753822 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1c4485b0-5db0-472e-8451-00740d5f408c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:50.754602 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1c4485b0-5db0-472e-8451-00740d5f408c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:50.883970 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1c4485b0-5db0-472e-8451-00740d5f408c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:50.891449 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1c4485b0-5db0-472e-8451-00740d5f408c tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1509 microversion: 2.1 time: 0.150401 May 26 20:38:50.892018 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 532/1057] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:50 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:50.907838 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a3451b9f-bbc9-4272-9a71-0d6d8ac7f106 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:38:50.908410 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a3451b9f-bbc9-4272-9a71-0d6d8ac7f106 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:50.915774 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a3451b9f-bbc9-4272-9a71-0d6d8ac7f106 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:50.916223 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a3451b9f-bbc9-4272-9a71-0d6d8ac7f106 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:50.916992 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a3451b9f-bbc9-4272-9a71-0d6d8ac7f106 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:50.917431 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a3451b9f-bbc9-4272-9a71-0d6d8ac7f106 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:51.114022 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a3451b9f-bbc9-4272-9a71-0d6d8ac7f106 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "POST /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.209936 May 26 20:38:51.114556 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 526/1058] 10.222.0.44 () {60 vars in 1277 bytes} [Thu May 26 20:38:50 2022] POST /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:38:51.122747 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-c1730fc5-0302-41d5-8163-72895e968281 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:51.123355 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-c1730fc5-0302-41d5-8163-72895e968281 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:51.129855 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c1730fc5-0302-41d5-8163-72895e968281 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:51.130339 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c1730fc5-0302-41d5-8163-72895e968281 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:51.131080 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c1730fc5-0302-41d5-8163-72895e968281 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:51.131507 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-c1730fc5-0302-41d5-8163-72895e968281 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:51.272311 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-c1730fc5-0302-41d5-8163-72895e968281 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:51.280246 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-c1730fc5-0302-41d5-8163-72895e968281 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1517 microversion: 2.1 time: 0.161197 May 26 20:38:51.281012 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 533/1059] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:51 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:52.090347 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-416a6f5b-3a37-4377-be1e-09569f9305bc req-5b612354-c370-41e8-ab26-21ebf302f5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e15353-2394-418f-923f-5122a70e7b5c", "name": "network-vif-unplugged", "status": "completed", "tag": "ea03b263-e8b3-4f50-9c7b-b6a26b329071"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:38:52.099430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-416a6f5b-3a37-4377-be1e-09569f9305bc req-5b612354-c370-41e8-ab26-21ebf302f5f9 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:52.099888 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-416a6f5b-3a37-4377-be1e-09569f9305bc req-5b612354-c370-41e8-ab26-21ebf302f5f9 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:52.111140 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.compute.server_external_events [req-416a6f5b-3a37-4377-be1e-09569f9305bc req-5b612354-c370-41e8-ab26-21ebf302f5f9 service nova] Unable to find a host for instance 44e15353-2394-418f-923f-5122a70e7b5c. Dropping event network-vif-unplugged {{(pid=118307) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 20:38:52.112018 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-416a6f5b-3a37-4377-be1e-09569f9305bc req-5b612354-c370-41e8-ab26-21ebf302f5f9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026099 May 26 20:38:52.113414 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 527/1060] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 20:38:52.297020 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-45064ec7-2fd9-417f-8854-82f92bf6cf39 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:52.297632 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-45064ec7-2fd9-417f-8854-82f92bf6cf39 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:52.305122 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-45064ec7-2fd9-417f-8854-82f92bf6cf39 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:52.305559 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-45064ec7-2fd9-417f-8854-82f92bf6cf39 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:52.306347 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-45064ec7-2fd9-417f-8854-82f92bf6cf39 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:52.306784 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-45064ec7-2fd9-417f-8854-82f92bf6cf39 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:52.440483 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-45064ec7-2fd9-417f-8854-82f92bf6cf39 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:52.448169 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-45064ec7-2fd9-417f-8854-82f92bf6cf39 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1517 microversion: 2.1 time: 0.155170 May 26 20:38:52.448731 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 534/1061] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:52 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:53.466185 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-fa8fc0bf-d59f-48a5-b487-0622438d3c1b tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:53.466817 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-fa8fc0bf-d59f-48a5-b487-0622438d3c1b tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:53.473430 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fa8fc0bf-d59f-48a5-b487-0622438d3c1b tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:53.473876 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fa8fc0bf-d59f-48a5-b487-0622438d3c1b tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:53.475182 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fa8fc0bf-d59f-48a5-b487-0622438d3c1b tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:53.475618 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-fa8fc0bf-d59f-48a5-b487-0622438d3c1b tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:53.608107 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-fa8fc0bf-d59f-48a5-b487-0622438d3c1b tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:53.616383 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-fa8fc0bf-d59f-48a5-b487-0622438d3c1b tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1519 microversion: 2.1 time: 0.153469 May 26 20:38:53.617797 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 528/1062] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:53 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:54.633109 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-5c3e6cdf-43bf-49c3-9915-3365408e29aa tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:54.633801 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-5c3e6cdf-43bf-49c3-9915-3365408e29aa tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:54.640259 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5c3e6cdf-43bf-49c3-9915-3365408e29aa tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:54.640704 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5c3e6cdf-43bf-49c3-9915-3365408e29aa tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:54.641465 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5c3e6cdf-43bf-49c3-9915-3365408e29aa tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:54.641896 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-5c3e6cdf-43bf-49c3-9915-3365408e29aa tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:54.772590 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-5c3e6cdf-43bf-49c3-9915-3365408e29aa tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:54.779972 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-5c3e6cdf-43bf-49c3-9915-3365408e29aa tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1575 microversion: 2.1 time: 0.151054 May 26 20:38:54.780540 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 535/1063] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:54 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:55.796891 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a05dd887-a860-4d1d-bed7-05f8ec51ad5a tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:55.797500 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a05dd887-a860-4d1d-bed7-05f8ec51ad5a tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:55.805831 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a05dd887-a860-4d1d-bed7-05f8ec51ad5a tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:55.806302 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a05dd887-a860-4d1d-bed7-05f8ec51ad5a tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:55.807069 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a05dd887-a860-4d1d-bed7-05f8ec51ad5a tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:55.807505 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a05dd887-a860-4d1d-bed7-05f8ec51ad5a tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:55.945317 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a05dd887-a860-4d1d-bed7-05f8ec51ad5a tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:55.953711 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a05dd887-a860-4d1d-bed7-05f8ec51ad5a tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1575 microversion: 2.1 time: 0.160668 May 26 20:38:55.954295 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 529/1064] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:55 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:56.971806 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-0795558d-1fbd-4472-967e-bd5030813920 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:56.972422 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-0795558d-1fbd-4472-967e-bd5030813920 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:56.979224 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0795558d-1fbd-4472-967e-bd5030813920 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:56.979677 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0795558d-1fbd-4472-967e-bd5030813920 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:56.980444 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0795558d-1fbd-4472-967e-bd5030813920 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:56.980878 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-0795558d-1fbd-4472-967e-bd5030813920 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:57.120011 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-0795558d-1fbd-4472-967e-bd5030813920 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:57.127534 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-0795558d-1fbd-4472-967e-bd5030813920 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1575 microversion: 2.1 time: 0.159622 May 26 20:38:57.128112 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 536/1065] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:56 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:58.145053 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-10eeb960-71e0-46b7-971d-ed5e708be910 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:58.145657 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-10eeb960-71e0-46b7-971d-ed5e708be910 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:58.152763 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-10eeb960-71e0-46b7-971d-ed5e708be910 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:58.153207 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-10eeb960-71e0-46b7-971d-ed5e708be910 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:58.153960 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-10eeb960-71e0-46b7-971d-ed5e708be910 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:58.154416 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-10eeb960-71e0-46b7-971d-ed5e708be910 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:58.285332 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-10eeb960-71e0-46b7-971d-ed5e708be910 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:58.292867 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-10eeb960-71e0-46b7-971d-ed5e708be910 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1575 microversion: 2.1 time: 0.151708 May 26 20:38:58.293458 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 530/1066] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:58 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:38:58.488216 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:38:58.488683 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Thu May 26 20:38:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:38:59.311861 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1c6d3c66-48d5-4710-adf8-f3788f556e57 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:38:59.312397 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-1c6d3c66-48d5-4710-adf8-f3788f556e57 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:38:59.319240 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1c6d3c66-48d5-4710-adf8-f3788f556e57 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:59.319684 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1c6d3c66-48d5-4710-adf8-f3788f556e57 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:59.320451 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1c6d3c66-48d5-4710-adf8-f3788f556e57 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:38:59.320887 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1c6d3c66-48d5-4710-adf8-f3788f556e57 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:38:59.452049 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-1c6d3c66-48d5-4710-adf8-f3788f556e57 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:38:59.457497 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1c6d3c66-48d5-4710-adf8-f3788f556e57 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1575 microversion: 2.1 time: 0.149620 May 26 20:38:59.458059 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 537/1067] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:38:59 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:39:00.475535 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-944b7b4b-5273-4556-9551-26838092f1f2 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:39:00.476233 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-944b7b4b-5273-4556-9551-26838092f1f2 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:39:00.482802 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-944b7b4b-5273-4556-9551-26838092f1f2 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:00.483285 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-944b7b4b-5273-4556-9551-26838092f1f2 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:00.484093 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-944b7b4b-5273-4556-9551-26838092f1f2 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:00.484530 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-944b7b4b-5273-4556-9551-26838092f1f2 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:00.611924 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-944b7b4b-5273-4556-9551-26838092f1f2 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:39:00.620148 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-944b7b4b-5273-4556-9551-26838092f1f2 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1575 microversion: 2.1 time: 0.149038 May 26 20:39:00.620704 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 531/1068] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:39:00 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:39:01.636776 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-bcce4fae-ea05-4ff4-8ca6-a1454e247252 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:39:01.637399 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-bcce4fae-ea05-4ff4-8ca6-a1454e247252 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:39:01.644011 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bcce4fae-ea05-4ff4-8ca6-a1454e247252 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:01.651518 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bcce4fae-ea05-4ff4-8ca6-a1454e247252 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:01.651518 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bcce4fae-ea05-4ff4-8ca6-a1454e247252 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:01.651518 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-bcce4fae-ea05-4ff4-8ca6-a1454e247252 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:01.781665 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-bcce4fae-ea05-4ff4-8ca6-a1454e247252 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:39:01.789348 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-bcce4fae-ea05-4ff4-8ca6-a1454e247252 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1575 microversion: 2.1 time: 0.157046 May 26 20:39:01.789917 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 538/1069] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:39:01 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:39:02.807064 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-f3b4e0c4-67c0-444d-8e0f-320a4b0403d8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:39:02.807628 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-f3b4e0c4-67c0-444d-8e0f-320a4b0403d8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:39:02.814395 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3b4e0c4-67c0-444d-8e0f-320a4b0403d8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:02.814853 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3b4e0c4-67c0-444d-8e0f-320a4b0403d8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:02.815659 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3b4e0c4-67c0-444d-8e0f-320a4b0403d8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:02.816102 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-f3b4e0c4-67c0-444d-8e0f-320a4b0403d8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:02.950083 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-f3b4e0c4-67c0-444d-8e0f-320a4b0403d8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:39:02.957965 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-f3b4e0c4-67c0-444d-8e0f-320a4b0403d8 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1575 microversion: 2.1 time: 0.155511 May 26 20:39:02.958566 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 532/1070] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:39:02 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:39:03.975363 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-e5e7c9b3-f9f9-408a-8443-5570de53a710 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:39:03.975966 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-e5e7c9b3-f9f9-408a-8443-5570de53a710 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:39:03.982539 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e5e7c9b3-f9f9-408a-8443-5570de53a710 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:03.982982 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e5e7c9b3-f9f9-408a-8443-5570de53a710 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:03.983727 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e5e7c9b3-f9f9-408a-8443-5570de53a710 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:03.984153 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-e5e7c9b3-f9f9-408a-8443-5570de53a710 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:04.115792 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-e5e7c9b3-f9f9-408a-8443-5570de53a710 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:39:04.124103 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-e5e7c9b3-f9f9-408a-8443-5570de53a710 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1575 microversion: 2.1 time: 0.152603 May 26 20:39:04.124773 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 539/1071] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:39:03 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:39:04.199555 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-e01c6f01-bb1a-4d33-9ab2-0c1d2c236b30 req-072fcdf7-0f66-4907-b44a-e99c29627ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e15353-2394-418f-923f-5122a70e7b5c", "name": "network-vif-plugged", "status": "completed", "tag": "ea03b263-e8b3-4f50-9c7b-b6a26b329071"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:39:04.211723 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e01c6f01-bb1a-4d33-9ab2-0c1d2c236b30 req-072fcdf7-0f66-4907-b44a-e99c29627ebb service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:04.212164 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-e01c6f01-bb1a-4d33-9ab2-0c1d2c236b30 req-072fcdf7-0f66-4907-b44a-e99c29627ebb service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:04.215929 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:39:04.222830 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-e01c6f01-bb1a-4d33-9ab2-0c1d2c236b30 req-072fcdf7-0f66-4907-b44a-e99c29627ebb service nova] Creating event network-vif-plugged:ea03b263-e8b3-4f50-9c7b-b6a26b329071 for instance 44e15353-2394-418f-923f-5122a70e7b5c on hv-cinder-84213 May 26 20:39:04.228009 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-e01c6f01-bb1a-4d33-9ab2-0c1d2c236b30 req-072fcdf7-0f66-4907-b44a-e99c29627ebb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034447 May 26 20:39:04.231583 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 533/1072] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:39:05.142044 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-f48ac538-85c7-4862-b835-9dd5d9cd4c56 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:39:05.142680 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-f48ac538-85c7-4862-b835-9dd5d9cd4c56 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:39:05.149393 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f48ac538-85c7-4862-b835-9dd5d9cd4c56 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:05.149858 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f48ac538-85c7-4862-b835-9dd5d9cd4c56 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:05.150713 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f48ac538-85c7-4862-b835-9dd5d9cd4c56 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:05.151210 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-f48ac538-85c7-4862-b835-9dd5d9cd4c56 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:05.287586 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-f48ac538-85c7-4862-b835-9dd5d9cd4c56 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:39:05.295955 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-f48ac538-85c7-4862-b835-9dd5d9cd4c56 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1575 microversion: 2.1 time: 0.157844 May 26 20:39:05.296517 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 540/1073] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:39:05 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:39:06.315207 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-d1510268-21c6-490c-8cd2-1e647d7e42f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:39:06.315842 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-d1510268-21c6-490c-8cd2-1e647d7e42f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:39:06.317729 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=33 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:39:06.324462 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d1510268-21c6-490c-8cd2-1e647d7e42f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:06.332679 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d1510268-21c6-490c-8cd2-1e647d7e42f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:06.332679 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d1510268-21c6-490c-8cd2-1e647d7e42f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:39:06.332679 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-d1510268-21c6-490c-8cd2-1e647d7e42f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:39:06.464423 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-d1510268-21c6-490c-8cd2-1e647d7e42f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:39:06.471971 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-d1510268-21c6-490c-8cd2-1e647d7e42f0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1562 microversion: 2.1 time: 0.162004 May 26 20:39:06.472544 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 534/1074] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:39:06 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:40:14.617113 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:40:14.617690 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Thu May 26 20:40:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:40:16.878837 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_api:SELECT=30 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:40:16.879788 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG dbcounter [-] [118306] Writing DB stats nova_cell1:SELECT=90 {{(pid=118306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:40:16.881717 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG dbcounter [-] [118307] Writing DB stats nova_api:SELECT=1 {{(pid=118307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:40:16.884487 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-513fc738-ad6b-48c4-8843-12fa0bd264e0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:40:16.885055 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-513fc738-ad6b-48c4-8843-12fa0bd264e0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:40:16.886092 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-523019be-43e4-4f6e-b27f-2b68296da745 req-5d939754-fff5-47ba-974b-7dca0d0726a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e15353-2394-418f-923f-5122a70e7b5c", "tag": "ea03b263-e8b3-4f50-9c7b-b6a26b329071"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:40:16.891543 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-513fc738-ad6b-48c4-8843-12fa0bd264e0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:16.892074 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-513fc738-ad6b-48c4-8843-12fa0bd264e0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:16.892911 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-513fc738-ad6b-48c4-8843-12fa0bd264e0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:16.893566 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-513fc738-ad6b-48c4-8843-12fa0bd264e0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:16.894808 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-523019be-43e4-4f6e-b27f-2b68296da745 req-5d939754-fff5-47ba-974b-7dca0d0726a9 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:16.895251 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-523019be-43e4-4f6e-b27f-2b68296da745 req-5d939754-fff5-47ba-974b-7dca0d0726a9 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:16.907484 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-523019be-43e4-4f6e-b27f-2b68296da745 req-5d939754-fff5-47ba-974b-7dca0d0726a9 service nova] Creating event network-changed:ea03b263-e8b3-4f50-9c7b-b6a26b329071 for instance 44e15353-2394-418f-923f-5122a70e7b5c on hv-cinder-84213 May 26 20:40:16.916578 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-523019be-43e4-4f6e-b27f-2b68296da745 req-5d939754-fff5-47ba-974b-7dca0d0726a9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036851 May 26 20:40:16.917405 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 535/1075] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:40:16.932009 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-513fc738-ad6b-48c4-8843-12fa0bd264e0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Going to try to terminate instance {{(pid=118306) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 20:40:17.298054 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-513fc738-ad6b-48c4-8843-12fa0bd264e0 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "DELETE /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 204 len: 0 microversion: 2.1 time: 0.421067 May 26 20:40:17.298680 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 541/1076] 10.222.0.44 () {58 vars in 1238 bytes} [Thu May 26 20:40:16 2022] DELETE /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 20:40:17.313780 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-555bcbac-c411-45c9-9704-6b67a8f67caf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:40:17.314837 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-555bcbac-c411-45c9-9704-6b67a8f67caf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:40:17.322830 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-555bcbac-c411-45c9-9704-6b67a8f67caf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:17.323473 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-555bcbac-c411-45c9-9704-6b67a8f67caf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:17.324193 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-555bcbac-c411-45c9-9704-6b67a8f67caf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:17.324670 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-555bcbac-c411-45c9-9704-6b67a8f67caf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:17.465617 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-555bcbac-c411-45c9-9704-6b67a8f67caf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:40:17.473252 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-555bcbac-c411-45c9-9704-6b67a8f67caf tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1568 microversion: 2.1 time: 0.164086 May 26 20:40:17.473898 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 536/1077] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:40:17 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:40:18.494203 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-607e4460-ab8c-4719-b3c0-5be57470e7da tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:40:18.495053 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-607e4460-ab8c-4719-b3c0-5be57470e7da tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:40:18.501648 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-607e4460-ab8c-4719-b3c0-5be57470e7da tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:18.502097 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-607e4460-ab8c-4719-b3c0-5be57470e7da tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:18.502882 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-607e4460-ab8c-4719-b3c0-5be57470e7da tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:18.503308 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-607e4460-ab8c-4719-b3c0-5be57470e7da tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:18.642827 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-607e4460-ab8c-4719-b3c0-5be57470e7da tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:40:18.650733 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-607e4460-ab8c-4719-b3c0-5be57470e7da tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1450 microversion: 2.1 time: 0.163544 May 26 20:40:18.651382 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 542/1078] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:40:18 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:40:19.400264 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [req-bf3ab945-600e-4e89-840b-34e5df1cfdf8 req-1838d174-0f29-468b-a78f-a45f4d67df39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e15353-2394-418f-923f-5122a70e7b5c", "name": "network-vif-deleted", "tag": "ea03b263-e8b3-4f50-9c7b-b6a26b329071"}]} {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 20:40:19.408435 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-bf3ab945-600e-4e89-840b-34e5df1cfdf8 req-1838d174-0f29-468b-a78f-a45f4d67df39 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:19.408904 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [req-bf3ab945-600e-4e89-840b-34e5df1cfdf8 req-1838d174-0f29-468b-a78f-a45f4d67df39 service nova] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:19.422885 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.compute.server_external_events [req-bf3ab945-600e-4e89-840b-34e5df1cfdf8 req-1838d174-0f29-468b-a78f-a45f4d67df39 service nova] Creating event network-vif-deleted:ea03b263-e8b3-4f50-9c7b-b6a26b329071 for instance 44e15353-2394-418f-923f-5122a70e7b5c on hv-cinder-84213 May 26 20:40:19.427983 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [req-bf3ab945-600e-4e89-840b-34e5df1cfdf8 req-1838d174-0f29-468b-a78f-a45f4d67df39 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086864 May 26 20:40:19.428597 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 537/1079] 10.222.0.44 () {64 vars in 1317 bytes} [Thu May 26 20:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 20:40:19.669504 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-9635dab7-c05c-4ccc-80fc-83cdf0587cca tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:40:19.670126 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-9635dab7-c05c-4ccc-80fc-83cdf0587cca tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:40:19.677767 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9635dab7-c05c-4ccc-80fc-83cdf0587cca tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:19.678206 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9635dab7-c05c-4ccc-80fc-83cdf0587cca tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:19.679010 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9635dab7-c05c-4ccc-80fc-83cdf0587cca tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:19.679478 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-9635dab7-c05c-4ccc-80fc-83cdf0587cca tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:19.747066 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.policy [None req-9635dab7-c05c-4ccc-80fc-83cdf0587cca tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118306) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:40:19.756813 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-9635dab7-c05c-4ccc-80fc-83cdf0587cca tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1220 microversion: 2.1 time: 0.089092 May 26 20:40:19.756813 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 543/1080] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:40:19 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:40:20.772845 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-a1f0fe4c-fa0f-486f-920b-81097e314c36 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:40:20.773728 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.compute.api [None req-a1f0fe4c-fa0f-486f-920b-81097e314c36 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118307) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:40:20.780124 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a1f0fe4c-fa0f-486f-920b-81097e314c36 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:20.780577 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a1f0fe4c-fa0f-486f-920b-81097e314c36 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:20.781341 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a1f0fe4c-fa0f-486f-920b-81097e314c36 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:20.781781 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a1f0fe4c-fa0f-486f-920b-81097e314c36 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:20.812972 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a1f0fe4c-fa0f-486f-920b-81097e314c36 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:20.813421 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG oslo_concurrency.lockutils [None req-a1f0fe4c-fa0f-486f-920b-81097e314c36 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:20.813870 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.objects.instance [None req-a1f0fe4c-fa0f-486f-920b-81097e314c36 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lazy-loading 'fault' on Instance uuid 44e15353-2394-418f-923f-5122a70e7b5c {{(pid=118307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 20:40:20.859641 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.policy [None req-a1f0fe4c-fa0f-486f-920b-81097e314c36 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5cf400b3c949889f374fad17846f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c995ba5f3954414839ae62d24643053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118307) authorize /opt/stack/nova/nova/policy.py:199}} May 26 20:40:20.866544 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-a1f0fe4c-fa0f-486f-920b-81097e314c36 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 200 len: 1179 microversion: 2.1 time: 0.098392 May 26 20:40:20.867737 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 538/1081] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:40:20 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 1179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 20:40:21.884907 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1f705899-536d-4998-aca0-5ce9dbfb7dcd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '>' {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:40:21.885457 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.compute.api [None req-1f705899-536d-4998-aca0-5ce9dbfb7dcd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] [instance: 44e15353-2394-418f-923f-5122a70e7b5c] Fetching instance by UUID {{(pid=118306) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 20:40:21.891945 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1f705899-536d-4998-aca0-5ce9dbfb7dcd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:21.892393 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1f705899-536d-4998-aca0-5ce9dbfb7dcd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:21.893152 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1f705899-536d-4998-aca0-5ce9dbfb7dcd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 20:40:21.893584 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG oslo_concurrency.lockutils [None req-1f705899-536d-4998-aca0-5ce9dbfb7dcd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Lock "eb70ed8b-e1e8-410e-9682-c3cef34f17da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 20:40:21.907399 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.wsgi [None req-1f705899-536d-4998-aca0-5ce9dbfb7dcd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] HTTP exception thrown: Instance 44e15353-2394-418f-923f-5122a70e7b5c could not be found. May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1f705899-536d-4998-aca0-5ce9dbfb7dcd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Request method failure captured: May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: request: GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c HTTP/1.1 May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept: application/json May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Accept-Encoding: identity May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Connection: close May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Length: 0 May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Content-Type: application/json May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Host: 10.222.0.44 May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Openstack-System-Scope: None May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: User-Agent: python-urllib3/1.26.9 May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Auth-Token: gAAAAABij-SsyBHRKSm08LQPSG3gy0f1OAwZVcC3VCVhcrFx4zTp0N8CmBlZeHSv_j7wwOKowQn23-wb2kHvKoLOcUXU0ETMSKscMhDU6_FOIsVOacUAovBNvJK756V_cCphZQdxl-l58nFJHQM_nAiyC-WKmX61EQtH0POvt1w0bV1m4gnXsno May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Id: None May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Domain-Name: None May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Identity-Status: Confirmed May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Is-Admin-Project: True May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Id: default May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Domain-Name: Default May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Id: 2c995ba5f3954414839ae62d24643053 May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Project-Name: tempest-TestShelveInstance-1080528680 May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Role: reader,member May 26 20:40:21.914961 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Roles: reader,member May 26 20:40:21.917720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2c995ba5f3954414839ae62d24643053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c995ba5f3954414839ae62d24643053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2c995ba5f3954414839ae62d24643053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2c995ba5f3954414839ae62d24643053"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] May 26 20:40:21.917720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant: tempest-TestShelveInstance-1080528680 May 26 20:40:21.917720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Id: 2c995ba5f3954414839ae62d24643053 May 26 20:40:21.917720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-Tenant-Name: tempest-TestShelveInstance-1080528680 May 26 20:40:21.917720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User: tempest-TestShelveInstance-1080528680-project May 26 20:40:21.917720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Id: default May 26 20:40:21.917720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Domain-Name: Default May 26 20:40:21.917720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Id: de5cf400b3c949889f374fad17846f2b May 26 20:40:21.917720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: X-User-Name: tempest-TestShelveInstance-1080528680-project May 26 20:40:21.917720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: method: > May 26 20:40:21.917720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: exception: Instance 44e15353-2394-418f-923f-5122a70e7b5c could not be found. May 26 20:40:21.917720 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: action_args: {'id': '44e15353-2394-418f-923f-5122a70e7b5c'} May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: {{(pid=118306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44e15353-2394-418f-923f-5122a70e7b5c could not be found. May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 20:40:21.918826 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44e15353-2394-418f-923f-5122a70e7b5c could not be found. May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44e15353-2394-418f-923f-5122a70e7b5c could not be found. May 26 20:40:21.920652 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: ERROR nova.api.openstack.wsgi May 26 20:40:21.922122 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: DEBUG nova.api.openstack.wsgi [None req-1f705899-536d-4998-aca0-5ce9dbfb7dcd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Returning 404 to user: Instance 44e15353-2394-418f-923f-5122a70e7b5c could not be found. {{(pid=118306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 20:40:21.922122 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO nova.api.openstack.requestlog [None req-1f705899-536d-4998-aca0-5ce9dbfb7dcd tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c" status: 404 len: 111 microversion: 2.1 time: 0.030786 May 26 20:40:21.922122 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: [pid: 118306|app: 0|req: 544/1082] 10.222.0.44 () {58 vars in 1235 bytes} [Thu May 26 20:40:21 2022] GET /compute/v2.1/servers/44e15353-2394-418f-923f-5122a70e7b5c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 20:40:22.136151 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: DEBUG nova.api.openstack.wsgi [None req-9ef57f1f-8b9e-47c9-a6ab-392068ddbe49 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] Calling method '.version_select at 0x7f2da43268b0>' {{(pid=118307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 20:40:22.213149 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO nova.api.openstack.requestlog [None req-9ef57f1f-8b9e-47c9-a6ab-392068ddbe49 tempest-TestShelveInstance-1080528680 tempest-TestShelveInstance-1080528680-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1565279704" status: 202 len: 0 microversion: 2.1 time: 0.081496 May 26 20:40:22.213731 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: [pid: 118307|app: 0|req: 539/1083] 10.222.0.44 () {58 vars in 1253 bytes} [Thu May 26 20:40:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1565279704 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 20:41:56.078955 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:41:56.079564 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Thu May 26 20:41:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:42:05.653928 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:42:05.654619 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Thu May 26 20:42:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:42:50.289405 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:42:50.290170 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Thu May 26 20:42:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:43:34.625292 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:43:34.625834 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Thu May 26 20:43:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:45:16.088128 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:45:16.088771 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Thu May 26 20:45:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:45:25.662999 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:45:25.663624 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Thu May 26 20:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:45:29.751238 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:45:29.751981 dv-cinder-842131-1-iscsi devstack@n-api.service[118307]: Thu May 26 20:45:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 20:45:38.500036 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 20:45:38.502388 dv-cinder-842131-1-iscsi devstack@n-api.service[118306]: Thu May 26 20:45:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!